00000001:02000400:0.0F:1783135204.604179:0:3302:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1783135228.043040:0:3523:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1783135229.918672:0:3579:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 391 MB/s 00000001:01000000:0.0:1783135230.168169:0:3579:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 443 MB/s 00000001:01000000:3.0:1783135230.418586:0:3579:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3671 MB/s 00000020:02000000:3.0:1783135231.087500:0:3615:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_84_g3203d2f 00000400:02000000:0.0:1783135232.246823:0:3630:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.106@tcp [8/256/0/180] 00008000:02000000:2.0F:1783135236.347863:0:3780:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1783135305.924644:0:5749:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783135322.780438:0:6499:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783135322.780444:0:6499:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1783135322.780445:0:6499:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783135322.780611:0:6499:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000003af96ede 00000080:02000400:3.0:1783135322.780622:0:6499:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1783135322.796856:0:6499:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1783135322.796872:0:6499:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783135322.807953:0:6499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000c38e37a4) 00000020:00000080:2.0:1783135322.807985:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783135322.913543:0:6499:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1783135322.913622:0:6499:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1783135322.940385:0:6499:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783135322.940943:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783135322.941019:0:6499:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783135322.941035:0:6499:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628edf49f 00000020:01000004:0.0:1783135322.941043:0:6499:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783135322.941048:0:6499:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783135322.941053:0:6499:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003af96ede from MGS 00000020:01000004:0.0:1783135322.941058:0:6499:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783135322.946395:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001c9a1a01) 00000020:00000080:0.0:1783135322.946444:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783135322.946792:0:6499:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003af96ede from MGS, refs=2 00080000:01000000:0.0:1783135322.946801:0:6499:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783135322.946809:0:6499:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628edf4ad 00000100:00100000:0.0:1783135322.946972:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783135322.947131:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783135322.947137:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783135322.950618:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783135322.950751:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783135322.953627:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135322.953823:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783135322.953831:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1783135322.960412:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1783135322.960425:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783135322.961210:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783135322.961218:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783135322.967999:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135322.968005:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135322.968007:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135322.968761:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135322.968765:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135322.968767:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135322.970729:0:6499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783135322.973546:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1783135323.224843:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1815 MB/s 00000001:01000000:2.0:1783135323.474231:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2287 MB/s 00000001:01000000:0.0:1783135323.724146:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 495 MB/s 00000001:01000000:2.0:1783135323.974771:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 887 MB/s 00080000:10000000:2.0:1783135323.980393:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1783135323.992309:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783135324.001038:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783135324.001226:0:6499:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783135324.001298:0:6499:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783135324.001563:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783135324.001591:0:6499:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783135324.001932:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135324.002361:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783135324.002368:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783135324.004453:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783135324.004468:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783135324.004956:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783135324.004963:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783135324.005926:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783135324.005950:0:6499:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.106@tcp' 00000020:01000004:2.0:1783135324.005952:0:6499:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783135324.006010:0:6499:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.106@tcp (typ=mgc) 00000020:00000080:2.0:1783135324.006022:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.106@tcp (00000000c14d0661) 00000020:00000080:2.0:1783135324.006038:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783135324.006176:0:6499:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008fa7cdf4@MGC192.168.204.106@tcp: add connection 192.168.204.106@tcp at head 00010000:00010000:2.0:1783135324.006360:0:6499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.106@tcp-0 is initialized 00000040:01000000:2.0:1783135324.006367:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 1 is initialized 10000000:01000000:3.0:1783135324.012818:0:6519:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783135324.012875:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.106@tcp (uuid dfae7aea-4aeb-4043-b6ee-9086d4d5ab49) 00000020:00000080:3.0:1783135324.012899:0:6499:0:(genops.c:1406:class_connect()) connect: client dfae7aea-4aeb-4043-b6ee-9086d4d5ab49, cookie 0xf7de4ef628edf4bb 00000100:00080000:3.0:1783135324.012911:0:6499:0:(import.c:512:import_select_connection()) MGC192.168.204.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135324.012916:0:6499:0:(import.c:626:import_select_connection()) MGC192.168.204.106@tcp: import 000000008fa7cdf4 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135324.012960:0:6499:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d71ddfa7 x1869752809029760/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135324.018686:0:6499:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS 00000020:01000004:3.0:1783135324.018721:0:6499:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783135324.018730:0:6499:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783135324.018763:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000009374002f) 00000020:00000080:3.0:1783135324.018789:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1783135324.018991:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d71ddfa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3645:1869752809029760:0@lo:250: 00000100:00100000:0.0:1783135324.019113:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135324.019157:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809029760 00000100:00100000:3.0:1783135324.019167:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809029760 00000100:00100000:3.0:1783135324.019200:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135324.019207:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004eafa14a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1869752809029760:12345-0@lo:250: 00010000:00080000:3.0:1783135324.019235:0:6515:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from dfae7aea-4aeb-4043-b6ee-9086d4d5ab49@0@lo t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1783135324.019255:0:6515:0:(genops.c:1406:class_connect()) connect: client dfae7aea-4aeb-4043-b6ee-9086d4d5ab49, cookie 0xf7de4ef628edf4c9 00010000:00010000:0.0:1783135324.019255:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135324.019317:0:6518:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00080000:3.0:1783135324.019368:0:6515:0:(import.c:65:import_set_state_nolock()) 000000005fd1b94f : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135324.019434:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004eafa14a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:3645:x1869752809029760:12345-0@lo:250: Request processed in 226us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135324.019442:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135324.023695:0:3645:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1783135324.023714:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.106@tcp: connect to target with instance 0 00000100:00080000:0.0:1783135324.023724:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1783135324.023729:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1783135324.023733:0:3645:0:(import.c:65:import_set_state_nolock()) 000000008fa7cdf4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1783135324.023739:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1783135324.023762:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1783135324.023772:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d71ddfa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3645:1869752809029760:0@lo:250: 00000100:00100000:3.0:1783135324.028363:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135324.033444:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783135324.033453:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783135324.037412:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783135324.037424:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783135324.043267:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783135324.043287:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783135324.044831:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135324.045013:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783135324.045019:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783135324.048077:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783135324.048344:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783135324.091607:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135324.091919:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783135324.091927:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783135324.093257:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1783135324.093270:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783135324.093951:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135324.094339:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783135324.094345:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783135324.095053:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783135324.095060:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783135324.095875:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135324.096052:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783135324.096058:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783135324.099601:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783135324.099625:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783135324.100352:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135324.100555:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783135324.100561:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1783135324.101594:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783135324.101606:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783135324.116756:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135324.116994:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783135324.117002:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783135324.120890:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783135324.120906:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783135324.124054:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783135324.124235:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783135324.126608:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783135324.126658:0:6499:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783135324.126788:0:6499:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783135324.126914:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783135324.126954:0:6499:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.106@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1783135324.126960:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783135324.126963:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135324.126964:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135324.126965:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135324.126966:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135324.126967:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135324.126968:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135324.126970:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135324.126971:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783135324.126972:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783135324.126974:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135324.126975:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135324.126978:0:6499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1783135324.126980:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135324.126981:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135324.126982:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135324.126983:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135324.126984:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135324.126985:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135324.126985:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135324.126986:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135324.126988:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783135324.126989:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783135324.126990:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135324.126991:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135324.127035:0:6499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783135324.127054:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d03abc57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809029888:0@lo:253: 00000100:00100000:2.0:1783135324.127369:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135324.127428:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000000d5cc471 going to sleep for 11 seconds 00000100:00100000:1.0:1783135324.127551:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809029888 00000100:00100000:1.0:1783135324.127560:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809029888 00000100:00100000:1.0:1783135324.127627:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135324.127636:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005882a2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:6499:x1869752809029888:12345-0@lo:253: 20000000:01000000:1.0:1783135324.127694:0:6517:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783135324.127698:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1783135324.128074:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783135324.128155:0:6517:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1783135324.128431:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135324.129434:0:6539:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1783135324.129722:0:6517:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783135324.129727:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1783135324.129731:0:6517:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1783135324.129734:0:6517:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1783135324.129746:0:6517:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1783135324.129927:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135324.130080:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1783135324.130173:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783135324.130203:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1783135324.130217:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1783135324.130229:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1783135324.130276:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1783135324.130283:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1783135324.130294:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1783135324.130299:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1783135324.130308:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1783135324.130312:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1783135324.130321:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1783135324.130332:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1783135324.130352:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783135324.130356:0:6517:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1783135324.130368:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135324.130455:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1783135324.130463:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783135324.130475:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1783135324.130500:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1783135324.130512:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1783135324.130519:0:6517:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1783135324.130539:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1783135324.130544:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783135324.130554:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1783135324.130565:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1783135324.130576:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1783135324.130583:0:6517:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1783135324.130611:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1783135324.130618:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1783135324.130628:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1783135324.130640:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1783135324.130693:0:6517:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1783135324.130712:0:6517:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1783135324.130719:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1783135324.131283:0:6540:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783135324.131447:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783135324.131465:0:6517:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.106@tcp for mdt 20000000:01000000:1.0:1783135324.131468:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:1.0:1783135324.131490:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783135324.131496:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783135324.131508:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783135324.131512:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:1.0:1783135324.131521:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783135324.131527:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783135324.131537:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783135324.131548:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783135324.131578:0:6517:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783135324.131581:0:6517:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783135324.131585:0:6517:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783135324.131638:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783135324.131640:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783135324.131923:0:6541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1783135324.132062:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1783135324.132079:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1783135324.132146:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1783135324.132157:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783135324.132158:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783135324.132358:0:6542:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1783135324.132474:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1783135324.132502:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1783135324.132514:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1783135324.132524:0:6517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135324.132526:0:6517:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1783135324.132531:0:6517:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783135324.132533:0:6517:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1783135324.132537:0:6517:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1783135324.132543:0:6517:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1783135324.132754:0:6543:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1783135324.132849:0:6517:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1783135324.142155:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1783135324.142203:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1783135324.142219:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1783135324.142249:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783135324.142276:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.142295:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.142305:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.142312:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.142334:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.142340:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.142823:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005c55f6ff already unused, calling callback (000000009f6c9720) 00010000:00010000:2.0:1783135324.142829:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.142838:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.142853:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.142861:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.142867:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005c55f6ff/0xf7de4ef628edf4d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135324.142894:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783135324.152976:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005882a2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:6499:x1869752809029888:12345-0@lo:253: Request processed in 25331us (25598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.152998:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135324.153138:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d03abc57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809029888:0@lo:253: 10000000:01000000:3.0:1783135324.153155:0:6499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783135324.153159:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135324.153160:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783135324.153162:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135324.153163:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1783135324.153164:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135324.153166:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135324.153167:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135324.153168:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783135324.153169:0:6499:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783135324.153171:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135324.153172:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783135324.153194:0:6499:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003af96ede from lustre-MDT0000 10000000:01000000:3.0:1783135324.153233:0:6499:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783135324.153236:0:6499:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783135324.153240:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ac66b5899c0 10000000:01000000:3.0:1783135324.153245:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135324.153254:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ac66b5899c0 from 1 10000000:01000000:3.0:1783135324.153257:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783135324.153299:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135324.153311:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135324.153320:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135324.153351:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002323d7dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030016:0@lo:101: 00000100:00100000:3.0:1783135324.153387:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135324.153451:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eda431ef going to sleep for 11 seconds 00000100:00100000:1.0:1783135324.153543:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809030016 00000100:00100000:1.0:1783135324.153550:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809030016 00000100:00100000:1.0:1783135324.153593:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135324.153601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e08d1870 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:6499:x1869752809030016:12345-0@lo:101: 00010000:00010000:1.0:1783135324.153615:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135324.153630:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000005a04a8d/0xf7de4ef628edf4de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf4d7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.153655:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005a04a8d/0xf7de4ef628edf4de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf4d7 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.153664:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000005a04a8d/0xf7de4ef628edf4de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf4d7 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.153673:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000005a04a8d, rc 0) 00000100:00100000:1.0:1783135324.153721:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e08d1870 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:6499:x1869752809030016:12345-0@lo:101: Request processed in 120us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135324.153727:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135324.153840:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002323d7dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030016:0@lo:101: 00010000:00010000:3.0:1783135324.153853:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135324.153861:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135324.153911:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002323d7dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030144:0@lo:501: 00000100:00100000:3.0:1783135324.153936:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135324.153995:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eda431ef going to sleep for 11 seconds 00000100:00100000:2.0:1783135324.157049:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809030144 00000100:00100000:2.0:1783135324.157072:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809030144 00000100:00100000:2.0:1783135324.157376:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135324.157386:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005129d675 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:6499:x1869752809030144:12345-0@lo:501: 00000100:00100000:2.0:1783135324.157564:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005129d675 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:6499:x1869752809030144:12345-0@lo:501: Request processed in 180us (3628us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135324.157575:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135324.157676:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002323d7dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030144:0@lo:501: 10000000:01000000:0.0:1783135324.157724:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783135324.157745:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.157757:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135324.157767:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ac64382e000 10000000:01000000:0.0:1783135324.157773:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783135324.157780:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ac64382e000 10000000:01000000:0.0:1783135324.157782:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783135324.157785:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8ac64382e000 from 1 10000000:01000000:0.0:1783135324.157787:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783135324.157840:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000b52ee1d3/0xf7de4ef628edf4e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.157848:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000b52ee1d3/0xf7de4ef628edf4e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.157856:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000b52ee1d3/0xf7de4ef628edf4e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135324.157880:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030272:0@lo:101: 00000100:00100000:0.0:1783135324.157916:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135324.157951:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000000c47b3b7 going to sleep for 11 seconds 00000100:00100000:0.0:1783135324.157974:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809030272 00000100:00100000:0.0:1783135324.157979:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809030272 00000100:00100000:0.0:1783135324.158001:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135324.158006:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027ed596b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:6499:x1869752809030272:12345-0@lo:101: 00010000:00010000:0.0:1783135324.158017:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135324.158031:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000deb3ab84/0xf7de4ef628edf4ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf4e5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158053:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000deb3ab84/0xf7de4ef628edf4ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf4e5 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158063:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000deb3ab84/0xf7de4ef628edf4ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf4e5 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158073:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000deb3ab84, rc 0) 00000100:00100000:0.0:1783135324.158135:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027ed596b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+7:6499:x1869752809030272:12345-0@lo:101: Request processed in 129us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135324.158141:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135324.158174:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030272:0@lo:101: 00010000:00010000:0.0:1783135324.158188:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000b52ee1d3/0xf7de4ef628edf4e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158197:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000b52ee1d3/0xf7de4ef628edf4e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135324.158221:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783135324.158225:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000b52ee1d3/0xf7de4ef628edf4e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158231:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000b52ee1d3/0xf7de4ef628edf4e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135324.158237:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783135324.158239:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783135324.158243:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ac64382e000 10000000:01000000:0.0:1783135324.158246:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783135324.158248:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783135324.158250:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783135324.158262:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158268:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158274:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135324.158285:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030400:0@lo:101: 00000100:00100000:0.0:1783135324.158308:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135324.158320:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000000c47b3b7 going to sleep for 11 seconds 00000100:00100000:0.0:1783135324.158334:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809030400 00000100:00100000:0.0:1783135324.158337:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809030400 00000100:00100000:0.0:1783135324.158354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135324.158359:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000734166f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+7:6499:x1869752809030400:12345-0@lo:101: 00010000:00010000:0.0:1783135324.158372:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135324.158379:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008054436d/0xf7de4ef628edf4fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf4f3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158392:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008054436d/0xf7de4ef628edf4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf4f3 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158398:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008054436d/0xf7de4ef628edf4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf4f3 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158404:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008054436d, rc 0) 00000100:00100000:0.0:1783135324.158429:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000734166f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+8:6499:x1869752809030400:12345-0@lo:101: Request processed in 70us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135324.158435:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135324.158463:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030400:0@lo:101: 00010000:00010000:0.0:1783135324.158474:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.158491:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135324.158542:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030528:0@lo:501: 00000100:00100000:0.0:1783135324.158570:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135324.158582:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000000c47b3b7 going to sleep for 11 seconds 00000100:00100000:0.0:1783135324.158595:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809030528 00000100:00100000:0.0:1783135324.158598:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809030528 00000100:00100000:0.0:1783135324.158614:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135324.158619:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6fedafe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+8:6499:x1869752809030528:12345-0@lo:501: 00000100:00100000:0.0:1783135324.158746:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6fedafe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:6499:x1869752809030528:12345-0@lo:501: Request processed in 127us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135324.158753:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135324.158781:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030528:0@lo:501: 00000100:00100000:0.0:1783135324.158807:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030656:0@lo:503: 00000100:00100000:0.0:1783135324.158842:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135324.158854:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000000c47b3b7 going to sleep for 11 seconds 00000100:00100000:0.0:1783135324.158867:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809030656 00000100:00100000:0.0:1783135324.158871:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809030656 00000100:00100000:0.0:1783135324.158887:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135324.158892:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032e5b41c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:6499:x1869752809030656:12345-0@lo:503: 00000100:00100000:0.0:1783135324.158982:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032e5b41c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:6499:x1869752809030656:12345-0@lo:503: Request processed in 88us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135324.158987:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135324.159028:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809030656:0@lo:503: 00000100:00100000:0.0:1783135324.159977:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6544:1869752809030784:0@lo:502: 00000100:00100000:0.0:1783135324.160030:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135324.160072:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b1d13461 going to sleep for 11 seconds 00000100:00100000:2.0:1783135324.160149:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809030784 00000100:00100000:2.0:1783135324.160155:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809030784 00000100:00100000:2.0:1783135324.160203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135324.160210:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003795c1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:6544:x1869752809030784:12345-0@lo:502: 00000100:00100000:2.0:1783135324.160312:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003795c1f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:6544:x1869752809030784:12345-0@lo:502: Request processed in 102us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.160319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135324.160442:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6544:1869752809030784:0@lo:502: 00000020:01000000:0.0:1783135324.160469:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135324.160491:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135324.160494:0:6544:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783135324.160500:0:6544:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783135324.160502:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135324.160527:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000c87e6b9) 00000020:00000080:0.0:1783135324.160546:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783135324.160560:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783135324.160644:0:6544:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783135324.160671:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628edf508 00000020:00000080:0.0:1783135324.160909:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783135324.160914:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135324.160917:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135324.160918:0:6544:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783135324.160920:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135324.160924:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135324.160925:0:6544:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783135324.160928:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135324.160934:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007c758331) 00000020:00000080:0.0:1783135324.160945:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783135324.160948:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783135324.160950:0:6544:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783135324.160953:0:6544:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783135324.160958:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783135324.161013:0:6544:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003af96ede from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783135324.161027:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006872f46d) 00000020:00000080:0.0:1783135324.161035:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783135324.161164:0:6544:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783135324.161171:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628edf51d 00000020:00000080:0.0:1783135324.161274:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783135324.161280:0:6544:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783135324.161284:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf7de4ef628edf524 00080000:01000000:0.0:1783135324.161289:0:6544:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783135324.161292:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628edf52b 00080000:10000000:0.0:1783135324.161744:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1783135324.161889:0:6544:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1783135324.174826:0:6544:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1783135324.259730:0:6544:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1783135324.260186:0:6544:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1783135324.263997:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1783135324.264496:0:6544:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783135324.267640:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000049c42036) 00000020:00000080:3.0:1783135324.267723:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783135324.267811:0:6544:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783135324.267819:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628edf539 00000020:00000080:3.0:1783135324.270789:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1783135324.271992:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1783135324.279546:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1783135324.288334:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1783135324.295359:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1783135324.300571:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1783135324.305855:0:6544:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1783135324.307408:0:6544:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf7de4ef628edf540 00000020:00000080:0.0:1783135324.307955:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783135324.307966:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135324.307972:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135324.307974:0:6544:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783135324.307976:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135324.307980:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135324.307981:0:6544:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783135324.307983:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783135324.307985:0:6544:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783135324.307987:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135324.307989:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135324.307990:0:6544:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783135324.307992:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135324.307996:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135324.307997:0:6544:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783135324.308000:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783135324.308035:0:6544:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1783135324.308154:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6544:1869752809030912:0@lo:502: 00000100:00100000:0.0:1783135324.308227:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135324.308271:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set 0000000092225f25 going to sleep for 11 seconds 00000100:00100000:1.0:1783135324.308353:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809030912 00000100:00100000:1.0:1783135324.308361:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809030912 00000100:00100000:1.0:1783135324.308404:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135324.308411:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ff7adce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:6544:x1869752809030912:12345-0@lo:502: 00000100:00100000:1.0:1783135324.308624:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ff7adce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:6544:x1869752809030912:12345-0@lo:502: Request processed in 213us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135324.308632:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135324.308714:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6544:1869752809030912:0@lo:502: 00000020:01000000:0.0:1783135324.308738:0:6544:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135324.308742:0:6544:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135324.308744:0:6544:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1783135324.308747:0:6544:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1783135324.308895:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1783135324.308917:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783135324.308937:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.308947:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135324.308954:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac64382e000 from 1 10000000:01000000:2.0:1783135324.308957:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135324.308984:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.308991:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.308999:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135324.309022:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000052dc1406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031040:0@lo:101: 00000100:00100000:2.0:1783135324.309048:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135324.309067:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000000d5cc471 going to sleep for 11 seconds 00000100:00100000:1.0:1783135324.309204:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809031040 00000100:00100000:1.0:1783135324.309208:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809031040 00000100:00100000:1.0:1783135324.309234:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135324.309239:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004250389b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:6499:x1869752809031040:12345-0@lo:101: 00010000:00010000:1.0:1783135324.309248:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135324.309261:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf54e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf547 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.309283:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf54e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf547 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.309292:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf54e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf547 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.309300:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b38e9bdb, rc 0) 00000100:00100000:1.0:1783135324.309333:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004250389b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:6499:x1869752809031040:12345-0@lo:101: Request processed in 94us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135324.309338:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135324.309417:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000052dc1406 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031040:0@lo:101: 00010000:00010000:0.0:1783135324.309429:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.309437:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135324.310009:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031168:0@lo:256: 00000100:00100000:0.0:1783135324.310052:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135324.310142:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 0000000092225f25 going to sleep for 11 seconds 00000100:00100000:1.0:1783135324.310314:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809031168 00000100:00100000:1.0:1783135324.310319:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809031168 00000100:00100000:1.0:1783135324.310358:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135324.310365:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8ae0da2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:6499:x1869752809031168:12345-0@lo:256: 20000000:01000000:1.0:1783135324.310383:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783135324.310389:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783135324.310458:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8ae0da2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:6499:x1869752809031168:12345-0@lo:256: Request processed in 93us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135324.310472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135324.312136:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031168:0@lo:256: 10000000:01000000:0.0:1783135324.312925:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135324.313217:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.313235:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135324.313244:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac64382e000 from 1 10000000:01000000:0.0:1783135324.313247:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135324.313296:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.313305:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.313314:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135324.313335:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031296:0@lo:101: 00000100:00100000:0.0:1783135324.313406:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135324.313979:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 0000000092225f25 going to sleep for 11 seconds 00000100:00100000:1.0:1783135324.314313:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809031296 00000100:00100000:1.0:1783135324.314321:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809031296 00000100:00100000:1.0:1783135324.314415:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135324.314425:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c200134d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:6499:x1869752809031296:12345-0@lo:101: 00010000:00010000:1.0:1783135324.314440:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135324.314456:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090de5818/0xf7de4ef628edf55c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf555 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.314492:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090de5818/0xf7de4ef628edf55c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf555 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.314503:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090de5818/0xf7de4ef628edf55c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf555 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.314521:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090de5818, rc 0) 00000100:00100000:1.0:1783135324.314579:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c200134d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:6499:x1869752809031296:12345-0@lo:101: Request processed in 155us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135324.314587:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135324.314680:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031296:0@lo:101: 00010000:00010000:0.0:1783135324.314697:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.314719:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135324.314784:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031424:0@lo:501: 00000100:00100000:0.0:1783135324.314812:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135324.315125:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 0000000092225f25 going to sleep for 11 seconds 00000100:00100000:2.0:1783135324.315268:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809031424 00000100:00100000:2.0:1783135324.315274:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809031424 00000100:00100000:2.0:1783135324.315300:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135324.315305:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006791e647 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:6499:x1869752809031424:12345-0@lo:501: 00000100:00100000:2.0:1783135324.315467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006791e647 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:6499:x1869752809031424:12345-0@lo:501: Request processed in 162us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.315485:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783135324.315633:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031424:0@lo:501: 00000100:00100000:0.0:1783135324.315675:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031552:0@lo:503: 00000100:00100000:0.0:1783135324.315716:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135324.315742:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 0000000092225f25 going to sleep for 11 seconds 00000100:00100000:2.0:1783135324.315861:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809031552 00000100:00100000:2.0:1783135324.315865:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809031552 00000100:00100000:2.0:1783135324.315882:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135324.315887:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041ed2645 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:6499:x1869752809031552:12345-0@lo:503: 00000040:00080000:2.0:1783135324.315919:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135324.315974:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041ed2645 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:6499:x1869752809031552:12345-0@lo:503: Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.315981:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135324.316048:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000feca229b pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031552:0@lo:503: 00000040:00080000:0.0:1783135324.316947:0:6548:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1783135324.317130:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783135324.317152:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135324.317167:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.317177:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135324.317236:0:6499:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783135324.317249:0:6499:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ac64382e000 10000000:01000000:2.0:1783135324.317252:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ac64382e000 10000000:01000000:2.0:1783135324.317256:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135324.317261:0:6499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac64382e000 from 1 10000000:01000000:2.0:1783135324.317264:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135324.317294:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.317304:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.317314:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135324.317331:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000095d1ff2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031680:0@lo:101: 00000100:00100000:2.0:1783135324.317373:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135324.317395:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b363b3af going to sleep for 11 seconds 00000100:00100000:2.0:1783135324.317417:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809031680 00000100:00100000:2.0:1783135324.317422:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809031680 00000100:00100000:2.0:1783135324.317451:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135324.317459:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7d999c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:6499:x1869752809031680:12345-0@lo:101: 00010000:00010000:2.0:1783135324.317471:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135324.317491:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b807087/0xf7de4ef628edf56a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf563 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.317524:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b807087/0xf7de4ef628edf56a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf563 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.317533:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b807087/0xf7de4ef628edf56a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf563 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.317555:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b807087, rc 0) 00000100:00100000:2.0:1783135324.317590:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7d999c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6499:x1869752809031680:12345-0@lo:101: Request processed in 131us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.317596:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135324.317637:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000095d1ff2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031680:0@lo:101: 00010000:00010000:2.0:1783135324.317651:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.317659:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135324.317837:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000095d1ff2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031808:0@lo:501: 00000100:00100000:2.0:1783135324.317862:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135324.317875:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b363b3af going to sleep for 11 seconds 00000100:00100000:2.0:1783135324.317888:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809031808 00000100:00100000:2.0:1783135324.317891:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809031808 00000100:00100000:2.0:1783135324.317906:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135324.317911:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064c11428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6499:x1869752809031808:12345-0@lo:501: 00000100:00100000:2.0:1783135324.318010:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064c11428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6499:x1869752809031808:12345-0@lo:501: Request processed in 99us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.318017:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135324.318046:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000095d1ff2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031808:0@lo:501: 00000100:00100000:2.0:1783135324.318070:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000095d1ff2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031936:0@lo:503: 00000100:00100000:2.0:1783135324.319157:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135324.319190:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b363b3af going to sleep for 11 seconds 00000100:00100000:2.0:1783135324.319236:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809031936 00000100:00100000:2.0:1783135324.319242:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809031936 00000100:00100000:2.0:1783135324.319275:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135324.319283:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053f79c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6499:x1869752809031936:12345-0@lo:503: 00000100:00100000:2.0:1783135324.319383:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053f79c61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6499:x1869752809031936:12345-0@lo:503: Request processed in 101us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.319390:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135324.319439:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000095d1ff2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809031936:0@lo:503: 00000100:00100000:3.0:1783135324.320299:0:6549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000067707b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6549:1869752809032064:0@lo:502: 00000100:00100000:3.0:1783135324.320355:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135324.320420:0:6549:0:(client.c:2701:ptlrpc_set_wait()) set 00000000347bbdb8 going to sleep for 11 seconds 00000100:00100000:2.0:1783135324.320583:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809032064 00000100:00100000:2.0:1783135324.320590:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809032064 00000100:00100000:2.0:1783135324.320674:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135324.320683:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3c86462 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6549:x1869752809032064:12345-0@lo:502: 00000100:00100000:2.0:1783135324.320792:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3c86462 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6549:x1869752809032064:12345-0@lo:502: Request processed in 110us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.320799:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135324.320868:0:6549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000067707b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6549:1869752809032064:0@lo:502: 00000020:01000004:3.0:1783135324.320932:0:6549:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783135324.320948:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a084c347) 00000020:00000080:3.0:1783135324.320967:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1783135324.321207:0:6549:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003af96ede from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783135324.321211:0:6549:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003af96ede from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783135324.321214:0:6549:0:(obd_mount.c:701:lustre_put_lsi()) put 000000003af96ede 4 00010000:00080000:3.0:1783135324.321244:0:6549:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000af7d047e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:3.0:1783135324.326647:0:6549:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1783135324.326774:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783135324.326821:0:6549:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783135324.326837:0:6549:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf7de4ef628edf578 00000100:00080000:3.0:1783135324.326847:0:6549:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135324.326853:0:6549:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000af7d047e using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135324.326893:0:6549:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000067707b4d x1869752809032192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135324.326947:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000067707b4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869752809032192:0@lo:38: 00000100:00100000:3.0:1783135324.327019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783135324.327074:0:6549:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783135324.327392:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809032192 00000100:00100000:0.0:1783135324.327400:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809032192 00000100:00100000:0.0:1783135324.327442:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135324.327449:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000727e0d2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869752809032192:12345-0@lo:38: 00000100:00100000:0.0:1783135324.327597:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000727e0d2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869752809032192:12345-0@lo:38: Request processed in 146us (577us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783135324.327605:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135324.328757:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135324.328769:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000af7d047e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135324.328775:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783135324.328779:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000067707b4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869752809032192:0@lo:38: 00000100:00100000:3.0:1783135324.329697:0:6549:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000067707b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6549:1869752809032320:0@lo:502: 00000100:00100000:3.0:1783135324.329775:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135324.329811:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809032320 00000100:00100000:3.0:1783135324.329817:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809032320 00000100:00100000:3.0:1783135324.329857:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135324.329866:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee89eaa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6549:x1869752809032320:12345-0@lo:502: 00000100:00100000:3.0:1783135324.329980:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee89eaa5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6549:x1869752809032320:12345-0@lo:502: Request processed in 116us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135324.329988:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135324.330046:0:6549:0:(client.c:2701:ptlrpc_set_wait()) set 00000000347bbdb8 going to sleep for 11 seconds 00000100:00100000:3.0:1783135324.330063:0:6549:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000067707b4d pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6549:1869752809032320:0@lo:502: 00000040:00080000:3.0:1783135324.330103:0:6549:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1783135324.330670:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1783135324.330695:0:6499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135324.330715:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.330727:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783135324.330774:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783135324.330777:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135324.330779:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135324.330780:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135324.330781:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135324.330782:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135324.330787:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135324.330788:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135324.330789:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783135324.330790:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783135324.330792:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135324.330793:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135324.330796:0:6499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1783135324.330798:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135324.330799:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135324.330799:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135324.330800:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135324.330801:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135324.330802:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135324.330803:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135324.330803:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135324.330804:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783135324.330805:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783135324.330806:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135324.330807:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135324.330824:0:6499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783135324.330835:0:6499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000095d1ff2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809032448:0@lo:253: 00000100:00100000:2.0:1783135324.330872:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135324.330886:0:6499:0:(client.c:2701:ptlrpc_set_wait()) set 000000000f3868f9 going to sleep for 11 seconds 00000100:00100000:3.0:1783135324.331060:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809032448 00000100:00100000:3.0:1783135324.331066:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809032448 00000100:00100000:3.0:1783135324.331125:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783135324.331132:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d87d8e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6499:x1869752809032448:12345-0@lo:253: 20000000:01000000:3.0:1783135324.331152:0:6515:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783135324.331164:0:6515:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783135324.337296:0:6515:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783135324.337340:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783135324.337780:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d87d8e37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6499:x1869752809032448:12345-0@lo:253: Request processed in 6643us (6903us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.337793:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783135324.337901:0:6499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000095d1ff2e pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6499:1869752809032448:0@lo:253: 10000000:01000000:3.0:1783135324.337915:0:6499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783135324.337918:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135324.337920:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783135324.337921:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135324.337922:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135324.337924:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135324.337925:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135324.337927:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135324.337928:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783135324.337929:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135324.337931:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135324.337932:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135324.337947:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783135324.337962:0:6499:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1783135324.342240:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783135324.342252:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783135324.342280:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.342300:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf54e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf547 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.342309:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.342385:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf54e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf547 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.342401:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf54e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf547 expref: 11 pid: 6515 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135324.342415:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004996d0d0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809032576:0@lo:104: 00000100:00100000:1.0:1783135324.342487:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135324.342619:0:6538:0:(client.c:2701:ptlrpc_set_wait()) set 000000001890ab9e going to sleep for 11 seconds 00000100:00100000:2.0:1783135324.342779:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809032576 00000100:00100000:2.0:1783135324.342788:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809032576 00000100:00100000:2.0:1783135324.342842:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135324.342851:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3b146fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6538:x1869752809032576:12345-0@lo:104: 00010000:00010000:2.0:1783135324.342864:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.342985:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135324.342991:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3b146fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6538:x1869752809032576:12345-0@lo:104: Request processed in 141us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.342999:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:3.0:1783135324.345006:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00010000:00010000:1.0:1783135324.345160:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135324.345167:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.345178:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005c55f6ff already unused, calling callback (0000000001e5aac5) 10000000:00010000:1.0:1783135324.345181:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.345190:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135324.345195:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135324.345201:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135324.345257:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.345264:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135324.345286:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.345300:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf547 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf54e expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135324.345325:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135324.345327:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135324.345328:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1783135324.345728:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783135324.346007:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:0.0:1783135324.346409:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004996d0d0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809032576:0@lo:104: 00010000:00010000:0.0:1783135324.346435:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135324.346631:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f5f91e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809032704:0@lo:103: 00000100:00100000:0.0:1783135324.346702:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1783135324.347420:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1783135324.347792:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1783135324.347957:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1783135324.348898:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809032704 00000100:00100000:2.0:1783135324.348916:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809032704 00010000:00010000:2.0:1783135324.348972:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf54e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf547 expref: 12 pid: 6515 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135324.349069:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135324.349081:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feca229b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:3647:x1869752809032704:12345-0@lo:103: 00010000:00010000:2.0:1783135324.349125:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135324.349132:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf54e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf547 expref: 12 pid: 6515 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349146:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf54e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf547 expref: 12 pid: 6515 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349170:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf54e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf547 expref: 12 pid: 6515 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349191:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349201:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135324.349226:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006974325s 00010000:00010000:2.0:1783135324.349231:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349249:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349255:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349261:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349267:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a4dd8761 already unused, calling callback (000000009f6c9720) 00010000:00010000:2.0:1783135324.349271:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349279:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349297:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135324.349309:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135324.349392:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feca229b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:3647:x1869752809032704:12345-0@lo:103: Request processed in 313us (2690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135324.349401:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135324.349883:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f5f91e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809032704:0@lo:103: 00010000:00010000:0.0:1783135324.350391:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.350402:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135324.350408:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf57f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1783135324.350960:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1783135324.351307:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1783135324.351587:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1783135324.351755:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1783135324.351944:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1783135324.352083:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1783135324.355229:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783135324.364645:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783135324.364904:0:6554:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1783135324.364908:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1783135324.365174:0:6555:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783135324.367383:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783135324.367503:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783135324.368483:0:6499:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783135324.368496:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783135324.370807:0:6555:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135324.372328:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135324.373459:0:6499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783135324.374011:0:6499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783135324.374064:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1783135324.374302:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135324.379710:0:6555:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783135324.379857:0:6555:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783135324.379862:0:6555:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:2.0:1783135324.380170:0:6499:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1783135324.381679:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1783135324.382030:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1783135324.382209:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783135324.382347:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783135324.382504:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1783135324.382908:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783135324.383040:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783135324.383904:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783135324.384051:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783135324.384433:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1783135324.384757:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1783135324.384977:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1783135324.385204:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783135324.385329:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783135324.385500:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783135324.385882:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783135324.386358:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783135324.386665:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783135324.386896:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783135324.387028:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1783135324.387359:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1783135324.387545:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1783135324.387696:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1783135324.388203:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1783135324.388328:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1783135324.388494:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1783135324.389308:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1783135324.389450:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1783135324.391051:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1783135324.391419:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1783135324.391880:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1783135324.392019:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1783135324.392660:0:6499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1783135324.413115:0:6499:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783135324.413170:0:6499:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3f9c1cc3988 00100000:10000000:3.0:1783135324.413180:0:6499:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1783135324.421639:0:6499:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783135324.421719:0:6499:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783135324.421751:0:6499:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1783135324.421772:0:6499:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1783135324.423393:0:6499:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135324.428776:0:6499:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1783135325.038408:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135326.063116:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135327.086801:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135328.113823:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135329.138595:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783135329.647214:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783135329.647225:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783135329.647228:0:468:0:(import.c:65:import_set_state_nolock()) 00000000af7d047e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135329.647254:0:468:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000af7d047e using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135329.647280:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e71ad2c8 x1869752809032960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135329.647323:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e71ad2c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869752809032960:0@lo:38: 00000100:00100000:3.0:1783135329.647405:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135329.647739:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000067707b4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809032832:0@lo:400: 00000100:00100000:0.0:1783135329.647775:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135329.647880:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809032960 00000100:00100000:0.0:1783135329.647888:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809032960 00000100:00100000:0.0:1783135329.647918:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135329.647925:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd73852b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809032960:12345-0@lo:38: 00010000:00080000:0.0:1783135329.647955:0:6524:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:0.0:1783135329.647988:0:6524:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf7de4ef628edf586 00000004:00100000:0.0:1783135329.648028:0:6524:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783135329.648156:0:6524:0:(import.c:65:import_set_state_nolock()) 0000000067740002 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135329.648217:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd73852b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869752809032960:12345-0@lo:38: Request processed in 292us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135329.648224:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783135329.648278:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e71ad2c8 x1869752809032960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135329.648292:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783135329.648299:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783135329.648304:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783135329.648307:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000af7d047e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135329.648312:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e71ad2c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869752809032960:0@lo:38: 00000100:00100000:3.0:1783135329.649658:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809032832 00000100:00100000:3.0:1783135329.649670:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809032832 00000100:00100000:3.0:1783135329.649732:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783135329.649740:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ededeb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:3648:x1869752809032832:12345-0@lo:400: 00000100:00100000:3.0:1783135329.649820:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ededeb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:3648:x1869752809032832:12345-0@lo:400: Request processed in 80us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135329.649835:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783135329.649894:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000067707b4d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809032832:0@lo:400: 00010000:00010000:1.0:1783135330.165245:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135330.309750:0:6800:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1783135331.182914:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783135331.182920:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac64382e000 from 3 10000000:01000000:2.0:1783135331.182925:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135331.182971:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135331.182984:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135331.182995:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135331.183020:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000810f93d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809033088:0@lo:101: 00000100:00100000:2.0:1783135331.183111:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135331.183157:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 0000000085ad69c7 going to sleep for 11 seconds 00000100:00100000:2.0:1783135331.183190:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809033088 00000100:00100000:2.0:1783135331.183197:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809033088 00000100:00100000:2.0:1783135331.183264:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783135331.183590:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ed4a98e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:6519:x1869752809033088:12345-0@lo:101: 00010000:00010000:2.0:1783135331.183605:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135331.183618:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099a75794/0xf7de4ef628edf594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf58d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135331.183643:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099a75794/0xf7de4ef628edf594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf58d expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135331.183654:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099a75794/0xf7de4ef628edf594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf58d expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135331.183664:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099a75794, rc 0) 00000100:00100000:2.0:1783135331.183790:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ed4a98e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6519:x1869752809033088:12345-0@lo:101: Request processed in 518us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135331.183797:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1783135331.183917:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135331.184574:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000810f93d5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809033088:0@lo:101: 00010000:00010000:3.0:1783135331.184594:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135331.184605:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135331.184665:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000067707b4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809033216:0@lo:256: 00000100:00100000:3.0:1783135331.184786:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135331.184821:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 000000005a52ce69 going to sleep for 11 seconds 00000100:00100000:2.0:1783135331.184866:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809033216 00000100:00100000:2.0:1783135331.184872:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809033216 00000100:00100000:2.0:1783135331.184910:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135331.184918:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064e1394e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6519:x1869752809033216:12345-0@lo:256: 20000000:01000000:2.0:1783135331.184934:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783135331.184951:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783135331.184954:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1783135331.185046:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064e1394e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:6519:x1869752809033216:12345-0@lo:256: Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135331.185053:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783135331.185171:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000067707b4d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809033216:0@lo:256: 10000000:01000000:1.0:1783135331.185228:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135331.185234:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135331.185242:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1783135331.586417:0:6852:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783135331.586595:0:6852:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135332.206677:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135333.232115:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135334.256147:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135334.767331:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000030530e21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809033472:0@lo:400: 00000100:00100000:3.0:1783135334.767410:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135334.767490:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809033472 00000100:00100000:3.0:1783135334.767498:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809033472 00000100:00100000:3.0:1783135334.767551:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135334.767560:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3801546 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809033472:12345-0@lo:400: 00000100:00100000:3.0:1783135334.767618:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3801546 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809033472:12345-0@lo:400: Request processed in 59us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135334.767626:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783135334.767669:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000030530e21 x1869752809033472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135334.767682:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000030530e21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809033472:0@lo:400: 00000100:00100000:2.0:1783135334.768207:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135334.768226:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003ee8f04a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809033344:0@lo:400: 00000100:00100000:2.0:1783135334.768273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135334.773995:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809033344 00000100:00100000:1.0:1783135334.774011:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809033344 00000100:00100000:1.0:1783135334.774075:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135334.774112:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e7360ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:3648:x1869752809033344:12345-0@lo:400: 00000100:00100000:1.0:1783135334.774220:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e7360ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:3648:x1869752809033344:12345-0@lo:400: Request processed in 110us (5947us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135334.774229:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135334.774314:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003ee8f04a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809033344:0@lo:400: 00000020:00000004:2.0:1783135334.843443:0:6954:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783135334.843695:0:6954:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135335.278462:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135336.306957:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135337.327158:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135338.350233:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135339.389634:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135339.886470:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cd9a59f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809033728:0@lo:400: 00000100:00100000:1.0:1783135339.886557:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135339.886808:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135339.886819:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005bd15417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809033600:0@lo:400: 00000100:00100000:2.0:1783135339.886856:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135339.886898:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809033600 00000100:00100000:2.0:1783135339.886906:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809033600 00000100:00100000:2.0:1783135339.886961:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135339.886970:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7ad6872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:3646:x1869752809033600:12345-0@lo:400: 00000100:00100000:2.0:1783135339.887024:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7ad6872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:3646:x1869752809033600:12345-0@lo:400: Request processed in 55us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135339.887032:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135339.887120:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005bd15417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809033600:0@lo:400: 00000100:00100000:0.0:1783135339.890583:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809033728 00000100:00100000:0.0:1783135339.890600:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809033728 00000100:00100000:0.0:1783135339.890687:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135339.890696:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d7bafff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809033728:12345-0@lo:400: 00000100:00100000:0.0:1783135339.890795:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d7bafff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809033728:12345-0@lo:400: Request processed in 99us (4238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135339.890803:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783135339.890969:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cd9a59f4 x1869752809033728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135339.890983:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cd9a59f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809033728:0@lo:400: 00010000:00010000:2.0:1783135340.399452:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135341.422791:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135342.447495:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135343.482454:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135344.496307:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135345.008331:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1ca6784 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809033984:0@lo:400: 00000100:00100000:0.0:1783135345.008411:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135345.008555:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809033984 00000100:00100000:0.0:1783135345.008565:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809033984 00000100:00100000:0.0:1783135345.008633:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135345.008650:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdd0e4ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809033984:12345-0@lo:400: 00000100:00100000:0.0:1783135345.008710:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdd0e4ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809033984:12345-0@lo:400: Request processed in 61us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135345.008718:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783135345.008763:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e1ca6784 x1869752809033984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135345.008777:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1ca6784 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809033984:0@lo:400: 00000100:00100000:1.0:1783135345.008862:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000096430e24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809033856:0@lo:400: 00000100:00100000:1.0:1783135345.008896:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135345.009032:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809033856 00000100:00100000:0.0:1783135345.009037:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809033856 00000100:00100000:0.0:1783135345.009076:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783135345.009082:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006605dbd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:3649:x1869752809033856:12345-0@lo:400: 00000100:00100000:0.0:1783135345.009309:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006605dbd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:3649:x1869752809033856:12345-0@lo:400: Request processed in 227us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135345.009316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135345.009378:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000096430e24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809033856:0@lo:400: 00010000:00010000:3.0:1783135345.524462:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135346.542338:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783135347.514617:0:7452:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783135347.514622:0:7452:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783135347.514623:0:7452:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783135347.514762:0:7452:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000ed086a25 00000020:01000004:3.0:1783135347.514778:0:7452:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1783135347.514789:0:7452:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783135347.514803:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000049167853) 00000020:00000080:3.0:1783135347.514817:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1783135347.570918:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1783135347.584675:0:7452:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1783135347.584763:0:7452:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1783135347.639493:0:7452:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783135347.639766:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1783135347.639780:0:7452:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783135347.639961:0:7452:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628edf5a2 00000020:01000004:0.0:1783135347.639973:0:7452:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783135347.639999:0:7452:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783135347.640004:0:7452:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783135347.640009:0:7452:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1783135347.640047:0:7452:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1783135347.640052:0:7452:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1783135347.654279:0:7452:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783135347.654315:0:7452:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.106@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1783135347.654320:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783135347.654325:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783135347.654326:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135347.654327:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135347.654328:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135347.654329:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135347.654330:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783135347.654331:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783135347.654332:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783135347.654334:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135347.654335:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783135347.654339:0:7452:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1783135347.654341:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783135347.654342:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783135347.654343:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135347.654344:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135347.654345:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135347.654346:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135347.654346:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783135347.654347:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783135347.654348:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783135347.654349:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135347.654350:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783135347.654377:0:7452:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783135347.654394:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e1ca6784 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809034112:0@lo:253: 00000100:00100000:0.0:1783135347.654462:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.654582:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000005adbe223 going to sleep for 11 seconds 00000100:00100000:2.0:1783135347.654657:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809034112 00000100:00100000:2.0:1783135347.654664:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809034112 00000100:00100000:2.0:1783135347.654711:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135347.654719:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dbbf537 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809034112:12345-0@lo:253: 20000000:01000000:2.0:1783135347.654751:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783135347.654755:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1783135347.654760:0:6517:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1783135347.654763:0:6517:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1783135347.654801:0:6517:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1783135347.654990:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135347.655166:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1783135347.655181:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783135347.655198:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1783135347.655215:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1783135347.655229:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1783135347.655283:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1783135347.655292:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1783135347.655306:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1783135347.655312:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1783135347.655325:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1783135347.655330:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1783135347.655341:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1783135347.655356:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1783135347.655471:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1783135347.655481:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:2.0:1783135347.655508:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1783135347.655515:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783135347.655527:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1783135347.655533:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:2.0:1783135347.655546:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1783135347.655551:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1783135347.655562:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1783135347.655575:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1783135347.655585:0:6517:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1783135347.655662:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1783135347.655671:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1783135347.655685:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1783135347.655701:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1783135347.655716:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1783135347.655730:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1783135347.655742:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1783135347.655757:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1783135347.655762:0:6517:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1783135347.655779:0:6517:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1783135347.655786:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1783135347.656248:0:7458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1783135347.656621:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1783135347.656643:0:6517:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.106@tcp for mdt 20000000:01000000:1.0:1783135347.656645:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:1.0:1783135347.656660:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1783135347.656669:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783135347.656681:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1783135347.656686:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:1.0:1783135347.656702:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1783135347.656720:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1783135347.656735:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1783135347.656749:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1783135347.656798:0:6517:0:(mgs_llog.c:3426:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1783135347.656806:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1783135347.657326:0:7459:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1783135347.657470:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1783135347.657486:0:6517:0:(mgs_llog.c:3484:mgs_write_log_osp_to_mdt()) add nid 192.168.204.106@tcp for mdt 20000000:01000000:1.0:1783135347.657488:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:1.0:1783135347.657502:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1783135347.657507:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783135347.657520:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1783135347.657526:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:1.0:1783135347.657538:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1783135347.657545:0:6517:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1783135347.657557:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1783135347.657666:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1783135347.657688:0:6517:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783135347.657691:0:6517:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783135347.657695:0:6517:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783135347.657739:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783135347.657741:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783135347.658210:0:7460:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1783135347.658231:0:7460:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1783135347.658261:0:7460:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1783135347.658496:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1783135347.658517:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1783135347.658537:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1783135347.658548:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783135347.658549:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783135347.658804:0:7461:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1783135347.658820:0:7461:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1783135347.659050:0:7461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1783135347.664029:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1783135347.664260:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1783135347.664278:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1783135347.664289:0:6517:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1783135347.664291:0:6517:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783135347.664640:0:7462:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1783135347.664661:0:7462:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1783135347.664676:0:7462:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1783135347.664874:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1783135347.664895:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1783135347.664913:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1783135347.665005:0:6517:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1783135347.665008:0:6517:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1783135347.665014:0:6517:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1783135347.665021:0:6517:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1783135347.665533:0:7463:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1783135347.665652:0:6517:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783135347.687279:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783135347.690343:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.690367:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000005a04a8d/0xf7de4ef628edf4de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf4d7 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.690373:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008054436d/0xf7de4ef628edf4fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf4f3 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.690378:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002b807087/0xf7de4ef628edf56a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf563 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.690385:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.690425:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002b807087/0xf7de4ef628edf56a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf563 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.690439:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002b807087/0xf7de4ef628edf56a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf563 expref: 12 pid: 6517 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135347.690465:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fea9827c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869752809034240:0@lo:104: 00000100:00100000:2.0:1783135347.690527:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135347.690619:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008054436d/0xf7de4ef628edf4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf4f3 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.690628:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008054436d/0xf7de4ef628edf4fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf4f3 expref: 12 pid: 6516 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135347.690635:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b61ae20d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869752809034368:0@lo:104: 00000100:00100000:2.0:1783135347.690658:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135347.690749:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000005a04a8d/0xf7de4ef628edf4de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf4d7 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.690756:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000005a04a8d/0xf7de4ef628edf4de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf4d7 expref: 12 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135347.690765:0:6517:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869752809034496:0@lo:104: 00000100:00100000:2.0:1783135347.690785:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.691398:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809034240 00000100:00100000:1.0:1783135347.691409:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809034240 00000100:00100000:1.0:1783135347.691453:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809034368 00000100:00100000:1.0:1783135347.691465:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809034368 00000100:00100000:1.0:1783135347.691482:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135347.691490:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000659a52e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6517:x1869752809034240:12345-0@lo:104: 00010000:00010000:1.0:1783135347.691503:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.691561:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135347.691566:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000659a52e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6517:x1869752809034240:12345-0@lo:104: Request processed in 78us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.691573:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135347.691590:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135347.691595:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a88d43e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6517:x1869752809034368:12345-0@lo:104: 00010000:00010000:1.0:1783135347.691601:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.691635:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783135347.691639:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a88d43e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6517:x1869752809034368:12345-0@lo:104: Request processed in 45us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.691644:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783135347.691721:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135347.691731:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.691738:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000859949ca already unused, calling callback (0000000001e5aac5) 10000000:00010000:3.0:1783135347.691742:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.691749:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135347.691755:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135347.691761:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135347.691796:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.691802:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135347.691823:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.691844:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 00000000859949ca/0xf7de4ef628edf563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf56a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.691856:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135347.691858:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.691862:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a78af296 already unused, calling callback (0000000001e5aac5) 10000000:00010000:3.0:1783135347.691864:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.691879:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135347.691884:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135347.691889:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135347.691904:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.691910:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135347.691933:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.691940:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf4f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf4fa expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.691950:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135347.691951:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135347.691952:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135347.692304:0:6517:0:(client.c:2701:ptlrpc_set_wait()) set 00000000045c6f0a going to sleep for 11 seconds 00000100:00100000:2.0:1783135347.692326:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fea9827c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869752809034240:0@lo:104: 00000100:00100000:2.0:1783135347.692335:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b61ae20d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869752809034368:0@lo:104: 00000100:00100000:3.0:1783135347.692387:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809034496 00000100:00100000:3.0:1783135347.692391:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809034496 00000100:00100000:3.0:1783135347.692414:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135347.692419:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008164db6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6517:x1869752809034496:12345-0@lo:104: 00010000:00010000:3.0:1783135347.692426:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.692476:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783135347.692481:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008164db6a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6517:x1869752809034496:12345-0@lo:104: Request processed in 62us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135347.692496:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783135347.692513:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135347.692516:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.692523:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c4aef460 already unused, calling callback (0000000001e5aac5) 10000000:00010000:3.0:1783135347.692525:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.692530:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135347.692537:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135347.692542:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135347.692559:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.692565:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135347.692571:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.692576:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf4d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf4de expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.692589:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135347.692590:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135347.692591:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135347.692639:0:6517:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1869752809034496:0@lo:104: 00010000:00010000:2.0:1783135347.692660:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.692736:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000030530e21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809034624:0@lo:103: 00000100:00100000:0.0:1783135347.692771:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135347.692858:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809034624 00000100:00100000:2.0:1783135347.692862:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809034624 00010000:00010000:2.0:1783135347.692890:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002b807087/0xf7de4ef628edf56a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf563 expref: 13 pid: 6517 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135347.693017:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135347.693025:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c65def7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:3647:x1869752809034624:12345-0@lo:103: 00010000:00010000:2.0:1783135347.693047:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135347.693053:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002b807087/0xf7de4ef628edf56a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf563 expref: 13 pid: 6517 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.693063:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002b807087/0xf7de4ef628edf56a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf563 expref: 13 pid: 6517 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.693112:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b807087/0xf7de4ef628edf56a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf563 expref: 13 pid: 6517 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.693125:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135347.693156:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c65def7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:3647:x1869752809034624:12345-0@lo:103: Request processed in 133us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135347.693162:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135347.693216:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000030530e21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809034624:0@lo:103: 00010000:00010000:1.0:1783135347.693734:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135347.693745:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008e1a36ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809034752:0@lo:103: 00000100:00100000:1.0:1783135347.693780:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.694059:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135347.694066:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002f9c07b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809034880:0@lo:103: 00000100:00100000:1.0:1783135347.694305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.694472:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809034752 00000100:00100000:0.0:1783135347.694478:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809034752 00010000:00010000:0.0:1783135347.694504:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008054436d/0xf7de4ef628edf4fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf4f3 expref: 12 pid: 6516 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.694559:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809034880 00000100:00100000:0.0:1783135347.694572:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809034880 00010000:00010000:0.0:1783135347.694585:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000005a04a8d/0xf7de4ef628edf4de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf4d7 expref: 13 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135347.694618:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135347.694634:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd9a59f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:3648:x1869752809034752:12345-0@lo:103: 00010000:00010000:3.0:1783135347.694645:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135347.694649:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008054436d/0xf7de4ef628edf4fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf4f3 expref: 13 pid: 6516 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694661:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008054436d/0xf7de4ef628edf4fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf4f3 expref: 13 pid: 6516 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694675:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008054436d/0xf7de4ef628edf4fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf4f3 expref: 13 pid: 6516 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694688:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135347.694731:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd9a59f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:3648:x1869752809034752:12345-0@lo:103: Request processed in 99us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135347.694738:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135347.694752:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135347.694758:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007995db37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:3648:x1869752809034880:12345-0@lo:103: 00010000:00010000:3.0:1783135347.694766:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135347.694769:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000005a04a8d/0xf7de4ef628edf4de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf4d7 expref: 11 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694776:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000005a04a8d/0xf7de4ef628edf4de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf4d7 expref: 11 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694785:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005a04a8d/0xf7de4ef628edf4de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf4d7 expref: 11 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694795:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694813:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694846:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694853:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694859:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694865:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694871:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004b910539 already unused, calling callback (000000009f6c9720) 00010000:00010000:3.0:1783135347.694874:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694881:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694897:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.694908:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135347.695228:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007995db37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:3648:x1869752809034880:12345-0@lo:103: Request processed in 470us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135347.695234:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135347.695314:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002f9c07b3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809034880:0@lo:103: 00000100:00100000:1.0:1783135347.695322:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008e1a36ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809034752:0@lo:103: 00010000:00010000:2.0:1783135347.695462:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.695470:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.695475:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004b910539/0xf7de4ef628edf5a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135347.695493:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1783135347.697711:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dbbf537 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:7452:x1869752809034112:12345-0@lo:253: Request processed in 42987us (43243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135347.697737:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135347.698247:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e1ca6784 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809034112:0@lo:253: 10000000:01000000:1.0:1783135347.698263:0:7452:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1783135347.698266:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135347.698268:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783135347.698269:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135347.698270:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1783135347.698271:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135347.698273:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135347.698274:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135347.698276:0:7452:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783135347.698278:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135347.698279:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783135347.698317:0:7452:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ed086a25 from lustre-MDT0001 10000000:01000000:1.0:1783135347.698344:0:7452:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1783135347.698347:0:7452:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1783135347.698353:0:7452:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ac66b5899c0 local copy 10000000:01000000:1.0:1783135347.698357:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783135347.698389:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.698399:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.698408:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135347.698424:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000445c13b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035008:0@lo:101: 00000100:00100000:1.0:1783135347.698460:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.698534:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000003cff3a7c going to sleep for 11 seconds 00000100:00100000:2.0:1783135347.699194:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809035008 00000100:00100000:2.0:1783135347.699202:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809035008 00000100:00100000:2.0:1783135347.699288:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135347.699297:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6504953 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:7452:x1869752809035008:12345-0@lo:101: 00010000:00010000:2.0:1783135347.699311:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135347.699324:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004203e689/0xf7de4ef628edf5b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf5b0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.699348:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004203e689/0xf7de4ef628edf5b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf5b0 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.699359:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004203e689/0xf7de4ef628edf5b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf5b0 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.699368:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004203e689, rc 0) 00000100:00100000:2.0:1783135347.699416:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6504953 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:7452:x1869752809035008:12345-0@lo:101: Request processed in 121us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135347.699422:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135347.699497:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000445c13b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035008:0@lo:101: 00010000:00010000:0.0:1783135347.699511:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.699519:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.699637:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035136:0@lo:501: 00000100:00100000:0.0:1783135347.699665:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.699778:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 000000008cd3c9ba going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.699859:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809035136 00000100:00100000:1.0:1783135347.699864:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809035136 00000100:00100000:1.0:1783135347.699889:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135347.699901:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad3d0ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:7452:x1869752809035136:12345-0@lo:501: 00000100:00100000:1.0:1783135347.700315:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad3d0ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:7452:x1869752809035136:12345-0@lo:501: Request processed in 413us (649us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135347.700323:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135347.700406:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035136:0@lo:501: 10000000:01000000:0.0:1783135347.700421:0:7452:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783135347.700439:0:7452:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783135347.700444:0:7452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.700453:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.700459:0:7452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.700487:0:7452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783135347.700512:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ac6743ed800 10000000:01000000:0.0:1783135347.700517:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783135347.700529:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ac66b5899c0 10000000:01000000:0.0:1783135347.700532:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783135347.700535:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8ac66b5899c0 from 1 10000000:01000000:0.0:1783135347.700538:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783135347.700560:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 000000009c83f04b/0xf7de4ef628edf5be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.700567:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 000000009c83f04b/0xf7de4ef628edf5be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.700574:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 000000009c83f04b/0xf7de4ef628edf5be lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.700588:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035264:0@lo:101: 00000100:00100000:0.0:1783135347.700613:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.700631:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000035e83d6 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.700683:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809035264 00000100:00100000:1.0:1783135347.700687:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809035264 00000100:00100000:1.0:1783135347.700707:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135347.700712:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a449544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:7452:x1869752809035264:12345-0@lo:101: 00010000:00010000:1.0:1783135347.700720:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135347.700730:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c88fefc8/0xf7de4ef628edf5c5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf5be expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.700747:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c88fefc8/0xf7de4ef628edf5c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf5be expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.700755:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c88fefc8/0xf7de4ef628edf5c5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf5be expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.700761:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c88fefc8, rc 0) 00000100:00100000:1.0:1783135347.700795:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a449544 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:7452:x1869752809035264:12345-0@lo:101: Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.700800:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1783135347.700821:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135347.700826:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.700845:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009ee7c60b already unused, calling callback (0000000001e5aac5) 10000000:00010000:1.0:1783135347.700848:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.700862:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135347.700868:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135347.700872:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135347.700887:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.700893:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135347.700910:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.700916:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf5b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7de4ef628edf5b7 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.701132:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035264:0@lo:101: 00010000:00010000:0.0:1783135347.701145:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 000000009c83f04b/0xf7de4ef628edf5be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf5c5 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.701153:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 000000009c83f04b/0xf7de4ef628edf5be lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf5c5 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135347.701166:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783135347.701177:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 000000009c83f04b/0xf7de4ef628edf5be lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf5c5 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.701183:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 000000009c83f04b/0xf7de4ef628edf5be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf5c5 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135347.701201:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ac6743ed800 10000000:01000000:0.0:1783135347.701217:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783135347.701221:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8ac6743ed800 from 1 10000000:01000000:0.0:1783135347.701223:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783135347.701236:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 000000004de31cdc/0xf7de4ef628edf5cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.701243:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 000000004de31cdc/0xf7de4ef628edf5cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.701250:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 000000004de31cdc/0xf7de4ef628edf5cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.701262:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035520:0@lo:101: 00000100:00100000:0.0:1783135347.701289:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.701301:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000035e83d6 going to sleep for 11 seconds 00010000:00010000:1.0:1783135347.701435:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135347.701438:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135347.701444:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135347.701455:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000954262cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809035392:0@lo:103: 00000100:00100000:1.0:1783135347.701484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.701526:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809035520 00000100:00100000:1.0:1783135347.701531:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809035520 00000100:00100000:1.0:1783135347.701554:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135347.701559:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6835425 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:7452:x1869752809035520:12345-0@lo:101: 00010000:00010000:1.0:1783135347.701567:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135347.701576:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c4484925/0xf7de4ef628edf5d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf5cc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.701597:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c4484925/0xf7de4ef628edf5d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf5cc expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.701604:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c4484925/0xf7de4ef628edf5d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf5cc expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.701610:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c4484925, rc 0) 00000100:00100000:1.0:1783135347.701638:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6835425 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809035520:12345-0@lo:101: Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.701643:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783135347.701717:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809035392 00000100:00100000:0.0:1783135347.701721:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809035392 00000100:00100000:0.0:1783135347.701759:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135347.701765:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000646a7c3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:3646:x1869752809035392:12345-0@lo:103: 00010000:00010000:0.0:1783135347.701773:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135347.701783:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004203e689/0xf7de4ef628edf5b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf5b0 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.701794:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135347.701818:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000646a7c3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:3646:x1869752809035392:12345-0@lo:103: Request processed in 53us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135347.701824:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135347.701870:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035520:0@lo:101: 00010000:00010000:0.0:1783135347.701881:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 000000004de31cdc/0xf7de4ef628edf5cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.701887:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 000000004de31cdc/0xf7de4ef628edf5cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135347.701896:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783135347.701903:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 000000004de31cdc/0xf7de4ef628edf5cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.701910:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 000000004de31cdc/0xf7de4ef628edf5cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135347.701916:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1783135347.702156:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783135347.702163:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ac6743ed800 10000000:01000000:0.0:1783135347.702165:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783135347.702168:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1783135347.702170:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783135347.702189:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000231d557a/0xf7de4ef628edf5da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.702197:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000231d557a/0xf7de4ef628edf5da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.702204:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000231d557a/0xf7de4ef628edf5da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.702216:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035648:0@lo:101: 00000100:00100000:0.0:1783135347.702250:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.702269:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000035e83d6 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.702341:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000954262cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809035392:0@lo:103: 00000100:00100000:1.0:1783135347.702365:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809035648 00000100:00100000:1.0:1783135347.702368:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809035648 00000100:00100000:1.0:1783135347.702388:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135347.702393:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee3883ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:7452:x1869752809035648:12345-0@lo:101: 00010000:00010000:1.0:1783135347.702400:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135347.702408:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf5e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf5da expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.702421:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf5da expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.702429:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a4dd8761/0xf7de4ef628edf5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf5da expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.702434:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a4dd8761, rc 0) 00000100:00100000:1.0:1783135347.702470:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee3883ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809035648:12345-0@lo:101: Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.702483:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783135347.702713:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035648:0@lo:101: 00010000:00010000:0.0:1783135347.702724:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000231d557a/0xf7de4ef628edf5da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.702731:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000231d557a/0xf7de4ef628edf5da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.702803:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035776:0@lo:501: 00000100:00100000:0.0:1783135347.702825:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.703266:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000035e83d6 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.703311:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809035776 00000100:00100000:1.0:1783135347.703316:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809035776 00000100:00100000:1.0:1783135347.703349:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135347.703355:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b95f0cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809035776:12345-0@lo:501: 00000100:00100000:1.0:1783135347.703461:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b95f0cff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809035776:12345-0@lo:501: Request processed in 107us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.703469:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783135347.703552:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035776:0@lo:501: 00000100:00100000:0.0:1783135347.703581:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035904:0@lo:503: 00000100:00100000:0.0:1783135347.703623:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.703643:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000035e83d6 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.703679:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809035904 00000100:00100000:1.0:1783135347.703683:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809035904 00000100:00100000:1.0:1783135347.703710:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135347.703716:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b9bd716 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809035904:12345-0@lo:503: 00000100:00100000:1.0:1783135347.703798:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b9bd716 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809035904:12345-0@lo:503: Request processed in 83us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.703804:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783135347.704016:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809035904:0@lo:503: 00000040:00080000:0.0:1783135347.704456:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135347.704529:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036032:0@lo:502: 00000100:00100000:0.0:1783135347.704567:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.704632:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000035e83d6 going to sleep for 11 seconds 00000100:00100000:3.0:1783135347.704721:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809036032 00000100:00100000:3.0:1783135347.704734:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809036032 00000100:00100000:2.0:1783135347.704918:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783135347.704936:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdf19a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809036032:12345-0@lo:502: 00000100:00100000:2.0:1783135347.705035:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdf19a29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809036032:12345-0@lo:502: Request processed in 110us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135347.705051:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783135347.705168:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036032:0@lo:502: 00000040:00080000:0.0:1783135347.705352:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783135347.705379:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1783135347.705394:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1783135347.705411:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1783135347.705435:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1783135347.705449:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1783135347.705460:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1783135347.705470:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1783135347.705481:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1783135347.705491:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1783135347.705502:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1783135347.705514:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1783135347.705527:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1783135347.705540:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1783135347.705552:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1783135347.705564:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1783135347.705578:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1783135347.705592:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1783135347.705605:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1783135347.705615:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1783135347.705626:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1783135347.705639:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1783135347.705651:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1783135347.705673:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036160:0@lo:502: 00000100:00100000:0.0:1783135347.705711:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.706508:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000035e83d6 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.706578:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809036160 00000100:00100000:1.0:1783135347.706586:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809036160 00000100:00100000:1.0:1783135347.706622:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135347.706630:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f7875ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809036160:12345-0@lo:502: 00000100:00100000:1.0:1783135347.706746:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f7875ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809036160:12345-0@lo:502: Request processed in 117us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.706753:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783135347.706865:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001da5a1d6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036160:0@lo:502: 00000040:00080000:0.0:1783135347.706934:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1783135347.706947:0:7452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1783135347.707611:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135347.707620:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135347.707622:0:7464:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783135347.707626:0:7464:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1783135347.707628:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135347.707653:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000002679673d) 00000020:00000080:0.0:1783135347.707674:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1783135347.707680:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783135347.707759:0:7464:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783135347.707776:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628edf5ef 00000020:00000080:0.0:1783135347.708363:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1783135347.708369:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135347.708373:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135347.708375:0:7464:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1783135347.708377:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135347.708381:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135347.708382:0:7464:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1783135347.708385:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135347.708394:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000c67906a2) 00000020:00000080:0.0:1783135347.708406:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1783135347.708410:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783135347.708412:0:7464:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1783135347.708414:0:7464:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1783135347.708421:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783135347.708489:0:7464:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ed086a25 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1783135347.708503:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000006fe6632e) 00000020:00000080:0.0:1783135347.708512:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1783135347.708587:0:7464:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783135347.708593:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628edf604 00000020:00000080:0.0:1783135347.708708:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1783135347.708714:0:7464:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783135347.708718:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf7de4ef628edf60b 00080000:01000000:0.0:1783135347.708723:0:7464:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783135347.708727:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628edf612 00080000:10000000:0.0:1783135347.709618:0:7464:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1783135347.709762:0:7464:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1783135347.842202:0:7464:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1783135347.843161:0:7464:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1783135347.849643:0:7464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1783135347.850390:0:7464:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783135347.873008:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1783135347.873022:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135347.873029:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135347.873031:0:7464:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1783135347.873045:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135347.873060:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135347.873061:0:7464:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1783135347.873065:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783135347.874043:0:7464:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:00000080:1.0:1783135347.874229:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135347.874261:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000071a935b2) 00000020:00000080:1.0:1783135347.874285:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1783135347.874366:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783135347.874494:0:7464:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1783135347.874501:0:7464:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783135347.874507:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628edf620 00010000:00080000:1.0:1783135347.874537:0:7464:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000037e322d8@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1783135347.884620:0:7464:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1783135347.885964:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783135347.885983:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783135347.886022:0:7464:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783135347.886057:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628edf627 00000100:00080000:3.0:1783135347.886627:0:7464:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135347.886635:0:7464:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000037e322d8 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135347.886674:0:7464:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f4fdef59 x1869752809036288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135347.886695:0:7464:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1783135347.886786:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135347.886791:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135347.886793:0:7464:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1783135347.886795:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783135347.886798:0:7464:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1783135347.886800:0:7464:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135347.886802:0:7464:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135347.886803:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783135347.886805:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135347.886806:0:7464:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783135347.886808:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135347.886814:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135347.886815:0:7464:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1783135347.886819:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783135347.886864:0:7464:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783135347.886878:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135347.886881:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135347.886888:0:7464:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1783135347.886890:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135347.886893:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135347.886894:0:7464:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783135347.886897:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783135347.886898:0:7464:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783135347.886934:0:7464:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135347.886937:0:7464:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135347.886938:0:7464:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783135347.886941:0:7464:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1783135347.887190:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f4fdef59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809036288:0@lo:38: 00000100:00100000:0.0:1783135347.887303:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1783135347.887910:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1783135347.887940:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783135347.887955:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000231d557a/0xf7de4ef628edf5da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.887967:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000231d557a/0xf7de4ef628edf5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135347.887974:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac6743ed800 from 1 10000000:01000000:1.0:1783135347.887976:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783135347.887999:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.888006:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.888016:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135347.888054:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a47d93cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036544:0@lo:101: 00000100:00100000:1.0:1783135347.888235:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.888261:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 0000000079766683 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.888280:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135347.888289:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000954262cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809036416:0@lo:400: 00000100:00100000:1.0:1783135347.888392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.888437:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809036544 00000100:00100000:1.0:1783135347.888444:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809036544 00000100:00100000:1.0:1783135347.888482:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135347.888490:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005926140a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+12:7452:x1869752809036544:12345-0@lo:101: 00010000:00010000:1.0:1783135347.888503:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135347.888513:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf62e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.888534:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf62e expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.888543:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf62e expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.888551:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b38e9bdb, rc 0) 00000100:00100000:1.0:1783135347.888586:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005926140a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:7452:x1869752809036544:12345-0@lo:101: Request processed in 97us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.888592:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135347.888635:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a47d93cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036544:0@lo:101: 00010000:00010000:1.0:1783135347.888648:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.888663:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135347.889263:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809036288 00000100:00100000:3.0:1783135347.889270:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809036288 00000100:00100000:3.0:1783135347.889454:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135347.889460:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001da5a1d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869752809036288:12345-0@lo:38: 00010000:00080000:3.0:1783135347.889481:0:6527:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:3.0:1783135347.889516:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628edf63c 00000004:00100000:3.0:1783135347.889529:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783135347.889534:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1783135347.890211:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809036416 00000100:00100000:3.0:1783135347.890219:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809036416 00000100:00100000:3.0:1783135347.890270:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135347.890278:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa5dc934 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809036416:12345-0@lo:400: 00000100:00100000:1.0:1783135347.890722:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a47d93cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036672:0@lo:256: 00000100:00100000:1.0:1783135347.890765:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.890797:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 0000000079766683 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.890825:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809036672 00000100:00100000:1.0:1783135347.890847:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809036672 00000100:00100000:1.0:1783135347.890878:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783135347.890884:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad25867f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:7452:x1869752809036672:12345-0@lo:256: 20000000:01000000:1.0:1783135347.890900:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783135347.890920:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783135347.890923:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1783135347.891002:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad25867f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:7452:x1869752809036672:12345-0@lo:256: Request processed in 117us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.891010:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783135347.891080:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a47d93cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036672:0@lo:256: 00000100:00100000:3.0:1783135347.891402:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa5dc934 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809036416:12345-0@lo:400: Request processed in 1125us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135347.891410:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:01000000:1.0:1783135347.894488:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135347.894522:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.894536:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135347.894545:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac6743ed800 from 1 10000000:01000000:1.0:1783135347.894548:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135347.894590:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.894607:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.894620:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135347.894644:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a47d93cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036800:0@lo:101: 00000100:00100000:1.0:1783135347.894709:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.894749:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 0000000079766683 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.894774:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809036800 00000100:00100000:1.0:1783135347.894781:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809036800 00000100:00100000:1.0:1783135347.894826:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783135347.894834:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c004f309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:7452:x1869752809036800:12345-0@lo:101: 00010000:00010000:1.0:1783135347.894849:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135347.894862:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009216cd3f/0xf7de4ef628edf64a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf643 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.894884:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009216cd3f/0xf7de4ef628edf64a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf643 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.894894:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009216cd3f/0xf7de4ef628edf64a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf643 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.894903:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009216cd3f, rc 0) 00000100:00100000:1.0:1783135347.894939:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c004f309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:7452:x1869752809036800:12345-0@lo:101: Request processed in 106us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.894946:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783135347.894996:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a47d93cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036800:0@lo:101: 00010000:00010000:1.0:1783135347.895017:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.895026:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135347.896601:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a47d93cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036928:0@lo:501: 00000100:00100000:1.0:1783135347.896653:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.896688:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 0000000079766683 going to sleep for 11 seconds 00000100:00100000:2.0:1783135347.896903:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809036928 00000100:00100000:2.0:1783135347.896910:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809036928 00000100:00100000:2.0:1783135347.897030:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135347.897051:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb644869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:7452:x1869752809036928:12345-0@lo:501: 00000100:00100000:2.0:1783135347.897176:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb644869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:7452:x1869752809036928:12345-0@lo:501: Request processed in 127us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135347.897183:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135347.897306:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a47d93cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809036928:0@lo:501: 00000100:00100000:2.0:1783135347.897338:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037056:0@lo:503: 00000100:00100000:2.0:1783135347.897643:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135347.897720:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b32d98c7 going to sleep for 11 seconds 00010000:00080000:0.0:1783135347.899710:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000954262cb x1869752809036416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135347.899731:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000954262cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809036416:0@lo:400: 00000100:00080000:1.0:1783135347.903282:0:6527:0:(import.c:65:import_set_state_nolock()) 000000009b13938b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135347.904480:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001da5a1d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869752809036288:12345-0@lo:38: Request processed in 15013us (17183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.904499:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135347.904764:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135347.904773:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1783135347.904782:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1783135347.904787:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783135347.904790:0:3645:0:(import.c:65:import_set_state_nolock()) 0000000037e322d8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135347.904811:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f4fdef59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809036288:0@lo:38: 00000100:00100000:2.0:1783135347.904984:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135347.905313:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809037056 00000100:00100000:3.0:1783135347.905324:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809037056 00000100:00100000:3.0:1783135347.905493:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783135347.905502:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3a64efb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:7452:x1869752809037056:12345-0@lo:503: 00000040:00080000:3.0:1783135347.905568:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135347.905631:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3a64efb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:7452:x1869752809037056:12345-0@lo:503: Request processed in 132us (7988us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135347.905639:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783135347.907462:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000934d26d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809037184:0@lo:41: 00000100:00100000:2.0:1783135347.907531:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135347.907639:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037056:0@lo:503: 00000040:00080000:2.0:1783135347.907944:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135347.907993:0:7452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1783135347.908124:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135347.908215:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809037184 00000100:00100000:1.0:1783135347.908222:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809037184 00000100:00100000:1.0:1783135347.908269:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135347.908277:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b61ae20d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1869752809037184:12345-0@lo:41: 00000004:00000024:1.0:1783135347.908318:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1783135347.908365:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b61ae20d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1869752809037184:12345-0@lo:41: Request processed in 89us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.908372:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135347.908507:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000934d26d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809037184:0@lo:41: 00000040:00080000:1.0:1783135347.912726:0:7469:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1783135347.918434:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783135347.918480:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135347.918501:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.918515:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135347.918579:0:7452:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783135347.918582:0:7452:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ac6743ed800 10000000:01000000:2.0:1783135347.918585:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ac6743ed800 10000000:01000000:2.0:1783135347.918588:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135347.918610:0:7452:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac6743ed800 from 1 10000000:01000000:2.0:1783135347.918613:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135347.918647:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 000000004b910539/0xf7de4ef628edf651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.918655:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 000000004b910539/0xf7de4ef628edf651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.918664:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 000000004b910539/0xf7de4ef628edf651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135347.918686:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037312:0@lo:101: 00000100:00100000:2.0:1783135347.918755:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135347.918847:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000efdc356b going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.922283:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809037312 00000100:00100000:1.0:1783135347.922369:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809037312 00000100:00100000:1.0:1783135347.922481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783135347.922490:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e14ddf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:7452:x1869752809037312:12345-0@lo:101: 00010000:00010000:1.0:1783135347.922509:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135347.922528:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000280b686c/0xf7de4ef628edf658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf651 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.922573:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000280b686c/0xf7de4ef628edf658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf651 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.922583:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000280b686c/0xf7de4ef628edf658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf651 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135347.922593:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000280b686c, rc 0) 00000100:00100000:1.0:1783135347.922673:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e14ddf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809037312:12345-0@lo:101: Request processed in 184us (3917us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.922679:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783135347.922766:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037312:0@lo:101: 00010000:00010000:2.0:1783135347.922784:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 000000004b910539/0xf7de4ef628edf651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.922792:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 000000004b910539/0xf7de4ef628edf651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135347.922924:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037440:0@lo:501: 00000100:00100000:2.0:1783135347.922957:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.926111:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809037440 00000100:00100000:0.0:1783135347.926129:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809037440 00000100:00100000:0.0:1783135347.926220:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783135347.926230:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a77e220 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809037440:12345-0@lo:501: 00000100:00100000:0.0:1783135347.926737:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a77e220 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809037440:12345-0@lo:501: Request processed in 507us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135347.926746:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135347.927191:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000efdc356b going to sleep for 11 seconds 00000100:00100000:2.0:1783135347.927219:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037440:0@lo:501: 00000100:00100000:2.0:1783135347.927270:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037568:0@lo:503: 00000100:00100000:2.0:1783135347.927670:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135347.927736:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000efdc356b going to sleep for 11 seconds 00000100:00100000:3.0:1783135347.927776:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809037568 00000100:00100000:3.0:1783135347.927782:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809037568 00000100:00100000:3.0:1783135347.928591:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783135347.928604:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058fa956a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809037568:12345-0@lo:503: 00000100:00100000:3.0:1783135347.928740:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058fa956a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809037568:12345-0@lo:503: Request processed in 140us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135347.928748:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135347.928845:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037568:0@lo:503: 00000040:00080000:2.0:1783135347.929178:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135347.929255:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037696:0@lo:502: 00000100:00100000:2.0:1783135347.929307:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135347.929984:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000efdc356b going to sleep for 11 seconds 00000100:00100000:0.0:1783135347.930021:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809037696 00000100:00100000:0.0:1783135347.930028:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809037696 00000100:00100000:1.0:1783135347.930261:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783135347.930270:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002447a3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809037696:12345-0@lo:502: 00000100:00100000:1.0:1783135347.930401:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002447a3d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809037696:12345-0@lo:502: Request processed in 133us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.930408:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783135347.930563:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037696:0@lo:502: 00000040:00080000:2.0:1783135347.930757:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783135347.930786:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783135347.930801:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783135347.930813:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783135347.930824:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783135347.931424:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783135347.931440:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783135347.931452:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783135347.931465:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783135347.931480:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783135347.931492:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783135347.931504:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783135347.931529:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783135347.931543:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783135347.931556:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783135347.931569:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783135347.931606:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783135347.931621:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783135347.931632:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783135347.931645:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783135347.931658:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783135347.931671:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783135347.931684:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783135347.931699:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783135347.931722:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1783135347.931732:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1783135347.931744:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1783135347.931757:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1783135347.931792:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037824:0@lo:502: 00000100:00100000:2.0:1783135347.932076:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135347.932128:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000efdc356b going to sleep for 11 seconds 00000100:00100000:3.0:1783135347.932270:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809037824 00000100:00100000:3.0:1783135347.932277:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809037824 00000100:00100000:3.0:1783135347.932318:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783135347.932325:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bf07814 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809037824:12345-0@lo:502: 00000100:00100000:3.0:1783135347.932429:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bf07814 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809037824:12345-0@lo:502: Request processed in 105us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135347.932437:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135347.932657:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809037824:0@lo:502: 00000040:00080000:2.0:1783135347.932709:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1783135347.932719:0:7452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1783135347.933366:0:7470:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1783135347.933382:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000d1cf8b94) 00000020:00000080:2.0:1783135347.933402:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1783135347.933703:0:7470:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ed086a25 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1783135347.933707:0:7470:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ed086a25 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1783135347.933710:0:7470:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000ed086a25 3 00010000:00080000:2.0:1783135347.933738:0:7470:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003b608480@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.106@tcp at head 00010000:00010000:2.0:1783135347.937451:0:7470:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1783135347.939936:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1783135347.939988:0:7470:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783135347.940002:0:7470:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf7de4ef628edf666 00000100:00080000:2.0:1783135347.940013:0:7470:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135347.940019:0:7470:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000003b608480 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135347.940257:0:7470:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000265961d4 x1869752809037952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135347.940302:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869752809037952:0@lo:38: 00000100:00100000:2.0:1783135347.940398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135347.940468:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809037952 00000100:00100000:2.0:1783135347.940480:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809037952 00000100:00100000:2.0:1783135347.940512:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135347.940589:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fea9827c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869752809037952:12345-0@lo:38: 00010000:00080000:2.0:1783135347.940612:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1783135347.940651:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf7de4ef628edf66d 00000004:00100000:2.0:1783135347.940666:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783135347.940702:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000d250bfed : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135347.940750:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fea9827c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869752809037952:12345-0@lo:38: Request processed in 162us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135347.940757:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783135347.940794:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000265961d4 x1869752809037952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135347.940804:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135347.940810:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1783135347.940817:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783135347.940821:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783135347.940824:0:3645:0:(import.c:65:import_set_state_nolock()) 000000003b608480 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783135347.942253:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869752809037952:0@lo:38: 00000100:00080000:2.0:1783135347.942286:0:7470:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1783135347.943828:0:7470:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1783135347.947300:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1783135347.947343:0:7452:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135347.947364:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 000000004b910539/0xf7de4ef628edf651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135347.947377:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 000000004b910539/0xf7de4ef628edf651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783135347.947424:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783135347.947427:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783135347.947432:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135347.947434:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135347.947435:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135347.947436:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135347.947437:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135347.947438:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135347.947439:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135347.947440:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135347.947442:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135347.947445:0:7452:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1783135347.947447:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135347.947448:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783135347.947449:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135347.947450:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135347.947451:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135347.947451:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135347.947452:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135347.947453:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135347.947453:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135347.947454:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135347.947455:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135347.947481:0:7452:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783135347.947500:0:7452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809038080:0@lo:253: 00000100:00100000:3.0:1783135347.947695:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135347.947737:0:7452:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ee55c163 going to sleep for 11 seconds 40000000:00080000:3.0:1783135347.947790:0:7472:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1783135347.947905:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809038080 00000100:00100000:1.0:1783135347.947913:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809038080 00000100:00100000:1.0:1783135347.947964:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783135347.947973:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000510e00c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809038080:12345-0@lo:253: 20000000:01000000:1.0:1783135347.948006:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783135347.948019:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1783135347.949748:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1783135347.949821:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783135347.949836:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1783135347.950271:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000510e00c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7452:x1869752809038080:12345-0@lo:253: Request processed in 2296us (2574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.950285:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 20000000:01000000:0.0:1783135347.950366:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783135347.950371:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783135347.950390:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.950405:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000099a75794/0xf7de4ef628edf594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf58d expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.950414:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf62e expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.950433:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.950466:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf62e expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.950479:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf635 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf62e expref: 14 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.950491:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cc97f255 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809038208:0@lo:104: 00000100:00100000:0.0:1783135347.950593:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135347.950642:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000099a75794/0xf7de4ef628edf594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf58d expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.950650:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000099a75794/0xf7de4ef628edf594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf58d expref: 14 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.950658:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001b564b8a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809038336:0@lo:104: 00000100:00100000:0.0:1783135347.950678:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.950696:0:6538:0:(client.c:2701:ptlrpc_set_wait()) set 00000000050d6aa9 going to sleep for 11 seconds 00000100:00100000:0.0:1783135347.950715:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809038208 00000100:00100000:0.0:1783135347.950721:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809038208 00000100:00100000:0.0:1783135347.950747:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809038336 00000100:00100000:0.0:1783135347.950750:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809038336 00000100:00100000:3.0:1783135347.951002:0:7452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7452:1869752809038080:0@lo:253: 10000000:01000000:3.0:1783135347.951019:0:7452:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1783135347.951022:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135347.951024:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783135347.951025:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135347.951027:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135347.951028:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135347.951029:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135347.951030:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135347.951042:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135347.951043:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135347.951045:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135347.951054:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783135347.951079:0:7452:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783135347.951711:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135347.951722:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dfc91ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6538:x1869752809038208:12345-0@lo:104: 00010000:00010000:0.0:1783135347.951736:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.951810:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135347.951816:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dfc91ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6538:x1869752809038208:12345-0@lo:104: Request processed in 98us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135347.951823:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135347.951838:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135347.951843:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e30aa9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6538:x1869752809038336:12345-0@lo:104: 00010000:00010000:0.0:1783135347.951849:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.951879:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783135347.951882:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e30aa9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6538:x1869752809038336:12345-0@lo:104: Request processed in 41us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135347.951888:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1783135347.951916:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135347.951920:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.951927:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009ee7c60b already unused, calling callback (0000000001e5aac5) 10000000:00010000:0.0:1783135347.951930:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.951937:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135347.951944:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135347.951950:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135347.951985:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.951992:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135347.952017:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.952023:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 000000009ee7c60b/0xf7de4ef628edf62e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf635 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.952045:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135347.952047:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.952053:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005c55f6ff already unused, calling callback (0000000001e5aac5) 10000000:00010000:0.0:1783135347.952054:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.952059:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135347.952666:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000050d6532d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809038464:0@lo:103: 00000100:00100000:2.0:1783135347.952709:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135347.952769:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809038464 00000100:00100000:2.0:1783135347.952775:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809038464 00010000:00010000:2.0:1783135347.952794:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf635 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf62e expref: 15 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135347.952833:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135347.952839:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000265961d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3649:x1869752809038464:12345-0@lo:103: 00010000:00010000:2.0:1783135347.952850:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135347.952854:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf635 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf62e expref: 15 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.952862:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf635 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf62e expref: 15 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135347.952879:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135347.952905:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000265961d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3649:x1869752809038464:12345-0@lo:103: Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135347.952911:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135347.952941:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000050d6532d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809038464:0@lo:103: 10000000:00010000:0.0:1783135347.953224:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135347.953229:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135347.953248:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953253:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783135347.953292:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a89f9dfc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809038592:0@lo:103: 00000100:00100000:1.0:1783135347.953330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135347.953759:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953777:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 000000005c55f6ff/0xf7de4ef628edf58d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf594 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953792:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135347.953794:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135347.953795:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135347.953803:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135347.953815:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809038592 00000100:00100000:0.0:1783135347.953820:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809038592 00010000:00010000:0.0:1783135347.953836:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000099a75794/0xf7de4ef628edf594 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf58d expref: 15 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.953856:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135347.953862:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2f6ee0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3646:x1869752809038592:12345-0@lo:103: 00010000:00010000:0.0:1783135347.953870:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135347.953873:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000099a75794/0xf7de4ef628edf594 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf58d expref: 15 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953881:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000099a75794/0xf7de4ef628edf594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf58d expref: 15 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953895:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953902:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783135347.953915:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006974325s 00010000:00010000:0.0:1783135347.953919:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953932:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953937:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953943:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953948:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c03d425e already unused, calling callback (000000009f6c9720) 00010000:00010000:0.0:1783135347.953950:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953957:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953963:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.953972:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00080000:10000000:2.0:1783135347.957756:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1783135347.957927:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783135347.958172:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783135347.958363:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783135347.958550:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783135347.958705:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1783135347.959454:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2f6ee0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3646:x1869752809038592:12345-0@lo:103: Request processed in 5588us (6119us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135347.959468:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1783135347.959655:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b38e9bdb/0xf7de4ef628edf635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf62e expref: 14 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.959670:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cc97f255 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809038208:0@lo:104: 00010000:00010000:0.0:1783135347.959681:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000099a75794/0xf7de4ef628edf594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf58d expref: 13 pid: 6515 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135347.959703:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001b564b8a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809038336:0@lo:104: 00010000:00010000:0.0:1783135347.959723:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.959732:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.959736:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135347.959741:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c03d425e/0xf7de4ef628edf674 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135347.959864:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a89f9dfc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809038592:0@lo:103: 00080000:10000000:2.0:1783135347.960755:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1783135347.961005:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1783135347.961812:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1783135347.962481:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1783135347.962771:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1783135347.962948:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1783135347.964891:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1783135347.965200:0:7476:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1783135347.965266:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008ee8f13e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1869752809038720:0@lo:700: 00000100:00100000:1.0:1783135347.965353:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.965393:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set 000000007e6a0e9a going to sleep for 11 seconds 00000100:00100000:0.0:1783135347.965457:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809038720 00000100:00100000:0.0:1783135347.965465:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809038720 00000100:00100000:0.0:1783135347.965509:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135347.965516:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040eda4aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1869752809038720:12345-0@lo:700: 00000040:01000000:3.0:1783135347.965725:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1783135347.966130:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d0061919 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869752809038848:0@lo:1000: 00000100:00100000:1.0:1783135347.966166:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.966197:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b78be2a2 going to sleep for 11 seconds 00000040:01000000:3.0:1783135347.966610:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1783135347.966715:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783135347.967179:0:7452:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783135347.967187:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1783135347.967326:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135347.968310:0:7452:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783135347.968823:0:7452:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783135347.968853:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1783135347.969047:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783135347.969297:0:7452:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783135347.969865:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1783135347.969994:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000100:00100000:0.0:1783135347.971463:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809038848 00000100:00100000:0.0:1783135347.971481:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809038848 00000100:00100000:0.0:1783135347.971558:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135347.971568:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004943bda2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869752809038848:12345-0@lo:1000: 00000100:00100000:0.0:1783135347.971688:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004943bda2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869752809038848:12345-0@lo:1000: Request processed in 122us (5521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135347.971695:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135347.971749:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d0061919 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869752809038848:0@lo:1000: 00000040:01000000:0.0:1783135347.971793:0:7477:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1783135347.971835:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001b564b8a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869752809038976:0@lo:700: 00000100:00100000:0.0:1783135347.971889:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.971917:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 00000000035e83d6 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.972047:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809038976 00000100:00100000:1.0:1783135347.972052:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809038976 00000100:00100000:1.0:1783135347.972115:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135347.972121:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc97f255 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1869752809038976:12345-0@lo:700: 00000100:00100000:1.0:1783135347.972169:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc97f255 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1869752809038976:12345-0@lo:700: Request processed in 48us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.972175:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135347.976178:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001b564b8a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869752809038976:0@lo:700: 00000100:00100000:0.0:1783135347.976273:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001b564b8a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1869752809039104:0@lo:900: 00000100:00100000:0.0:1783135347.976358:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135347.976393:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 00000000035e83d6 going to sleep for 11 seconds 00000020:00080000:2.0:1783135347.978581:0:7475:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1783135347.978590:0:7475:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783135347.978644:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809039104 00000100:00100000:2.0:1783135347.978653:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809039104 00000100:00100000:2.0:1783135347.978704:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135347.978712:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feca229b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7477:x1869752809039104:12345-0@lo:900: 00000100:00100000:2.0:1783135347.979526:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feca229b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7477:x1869752809039104:12345-0@lo:900: Request processed in 801us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135347.979537:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 40000000:02000000:0.0:1783135347.979873:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00010000:00080000:1.0:1783135347.984548:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001b564b8a x1869752809039104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783135363 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135347.984570:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001b564b8a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1869752809039104:0@lo:900: 00100000:10000000:2.0:1783135347.989042:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1783135347.989293:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1783135347.989458:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1783135347.989931:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1783135347.990269:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1783135347.990610:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1783135347.990754:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1783135347.992302:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000100:00100000:3.0:1783135347.995578:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869752809039232:0@lo:1000: 00000100:00100000:3.0:1783135347.995673:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135347.995729:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c98a146d going to sleep for 11 seconds 00100000:10000000:2.0:1783135347.996483:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:0.0:1783135347.996912:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040eda4aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1869752809038720:12345-0@lo:700: Request processed in 31394us (31558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135347.996922:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135347.997566:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809039232 00000100:00100000:1.0:1783135347.997576:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809039232 00000100:00100000:1.0:1783135347.997630:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135347.997638:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002ea4190 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869752809039232:12345-0@lo:1000: 00000100:00100000:1.0:1783135347.997734:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002ea4190 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869752809039232:12345-0@lo:1000: Request processed in 96us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.997741:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783135347.997793:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008ee8f13e x1869752809038720/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783135363 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135347.997809:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008ee8f13e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1869752809038720:0@lo:700: 40000000:02000000:1.0:1783135347.997820:0:7476:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1783135348.000968:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000100:00100000:0.0:1783135348.001175:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869752809039232:0@lo:1000: 00000004:00080000:0.0:1783135348.001246:0:7477:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000dd9bf900 with version 0 00000020:00100000:0.0:1783135348.001273:0:7477:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783135348.001279:0:7477:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002c65def7 x1869752809039488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135348.001301:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002c65def7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869752809039488:0@lo:1000: 00000100:00100000:0.0:1783135348.001378:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135348.001423:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809039488 00000100:00100000:0.0:1783135348.001430:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809039488 00000100:00100000:0.0:1783135348.001469:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135348.001476:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008143231 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869752809039488:12345-0@lo:1000: 00000100:00100000:0.0:1783135348.001792:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 00000000035e83d6 going to sleep for 11 seconds 00100000:10000000:2.0:1783135348.002737:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1783135348.002902:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1783135348.003025:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1783135348.003231:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1783135348.003818:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1783135348.004008:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1783135348.006996:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1783135348.007740:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000001:00080000:3.0:1783135348.010586:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1783135348.010855:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008143231 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1869752809039488:12345-0@lo:1000: Request processed in 9376us (9475us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783135348.010869:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1783135348.011125:0:7477:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1783135348.011130:0:7477:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783135348.011146:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002c65def7 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869752809039488:0@lo:1000: 00000100:00100000:3.0:1783135348.011238:0:7477:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002bee53d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869752809039616:0@lo:1000: 00000100:00100000:3.0:1783135348.011278:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135348.011310:0:7477:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a4666d5 going to sleep for 11 seconds 00000100:00100000:0.0:1783135348.011455:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809039616 00000100:00100000:0.0:1783135348.011471:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809039616 00000100:00100000:0.0:1783135348.011584:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135348.011594:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022c814c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1869752809039616:12345-0@lo:1000: 00000100:00100000:0.0:1783135348.011675:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022c814c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1869752809039616:12345-0@lo:1000: Request processed in 83us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135348.011682:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135348.011812:0:7477:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002bee53d9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1869752809039616:0@lo:1000: 00000040:00080000:3.0:1783135348.011999:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1783135348.012044:0:7477:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002fe04ca5 with version 1 00000004:00080000:0.0:1783135348.013639:0:7467:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a04c507b version 1 rpc_version 1 00000020:00100000:0.0:1783135348.013679:0:7467:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783135348.013688:0:7467:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d6a5eece x1869752809039872/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135348.013708:0:7467:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d6a5eece pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7467:1869752809039872:0@lo:1000: 00000100:00100000:0.0:1783135348.013767:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135348.013809:0:7467:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ae61abea going to sleep for 11 seconds 00100000:10000000:2.0:1783135348.014014:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000100:00100000:0.0:1783135348.014984:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809039872 00000100:00100000:0.0:1783135348.014996:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809039872 00000100:00100000:0.0:1783135348.015057:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135348.015066:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005251010 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1869752809039872:12345-0@lo:1000: 00100000:10000000:0.0:1783135348.018304:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1783135348.021205:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00000040:00080000:3.0:1783135348.024058:0:7477:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783135348.024204:0:7477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 1, retries 0 00100000:10000000:0.0:1783135348.024800:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1783135348.025016:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1783135348.025190:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1783135348.025323:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1783135348.025474:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1783135348.025606:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1783135348.025785:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1783135348.025891:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1783135348.026020:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1783135348.026251:0:7452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1783135348.032505:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000004:00080000:1.0:1783135348.033263:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1783135348.033270:0:7467:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783135348.033290:0:7467:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d6a5eece pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7467:1869752809039872:0@lo:1000: 00000100:00100000:0.0:1783135348.035614:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005251010 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1869752809039872:12345-0@lo:1000: Request processed in 20542us (21840us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783135348.035630:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00080000:0.0:1783135348.036992:0:7452:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783135348.037041:0:7452:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa3f9c1d4b988 00100000:10000000:0.0:1783135348.037049:0:7452:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1783135348.038020:0:7452:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783135348.038070:0:7452:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783135348.038134:0:7452:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783135348.038154:0:7452:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1783135348.040256:0:7452:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135348.040487:0:7452:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1783135348.094493:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135348.109658:0:7476:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783135348.109742:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1783135348.109748:0:7476:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1783135348.604237:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135349.621188:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135350.640165:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135351.671617:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135352.688160:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135353.082950:0:7722:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783135353.198707:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809040384:0@lo:400: 00000100:00100000:1.0:1783135353.198788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135353.198850:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135353.198856:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002bee53d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809040000:0@lo:400: 00000100:00100000:1.0:1783135353.198887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135353.198983:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809040384 00000100:00100000:3.0:1783135353.198992:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809040384 00000100:00100000:3.0:1783135353.199056:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135353.199065:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ee8f13e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809040384:12345-0@lo:400: 00000100:00100000:3.0:1783135353.199142:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ee8f13e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809040384:12345-0@lo:400: Request processed in 78us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135353.199149:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783135353.199193:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000062efb407 x1869752809040384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135353.199206:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809040384:0@lo:400: 00000100:00100000:2.0:1783135353.199595:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000043ece8ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809040256:0@lo:400: 00000100:00100000:2.0:1783135353.199627:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135353.199659:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135353.199665:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000069a5c8c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809040128:0@lo:400: 00000100:00100000:2.0:1783135353.199689:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135353.199715:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809040128 00000100:00100000:2.0:1783135353.199719:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809040128 00000100:00100000:2.0:1783135353.199746:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135353.199751:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f1979c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809040128:12345-0@lo:400: 00000100:00100000:2.0:1783135353.199789:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f1979c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809040128:12345-0@lo:400: Request processed in 38us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135353.199795:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783135353.199818:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000069a5c8c1 x1869752809040128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135353.199828:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000069a5c8c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809040128:0@lo:400: 00000100:00100000:2.0:1783135353.199875:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809040000 00000100:00100000:2.0:1783135353.199879:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809040000 00000100:00100000:2.0:1783135353.199906:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783135353.199912:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5ddeaf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:3646:x1869752809040000:12345-0@lo:400: 00000100:00100000:2.0:1783135353.200319:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5ddeaf1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:3646:x1869752809040000:12345-0@lo:400: Request processed in 407us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135353.200327:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783135353.200356:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051515979 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809040512:0@lo:41: 00000100:00100000:2.0:1783135353.200379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135353.200420:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809040256 00000100:00100000:2.0:1783135353.200424:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809040256 00000100:00100000:2.0:1783135353.200442:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809040512 00000100:00100000:2.0:1783135353.200444:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809040512 00000100:00100000:2.0:1783135353.200454:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135353.200459:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fd7180e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1869752809040256:12345-0@lo:400: 00000100:00100000:2.0:1783135353.200502:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fd7180e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1869752809040256:12345-0@lo:400: Request processed in 43us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135353.200509:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135353.200521:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135353.200526:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f70b97ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809040512:12345-0@lo:41: 00000004:00000024:2.0:1783135353.200550:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1783135353.200585:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f70b97ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809040512:12345-0@lo:41: Request processed in 60us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135353.200591:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135353.200619:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051515979 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809040512:0@lo:41: 00000100:00100000:2.0:1783135353.200642:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000043ece8ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809040256:0@lo:400: 00000100:00100000:3.0:1783135353.212133:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002bee53d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809040000:0@lo:400: 00010000:00010000:1.0:1783135353.710518:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783135354.225439:0:7774:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783135354.225631:0:7774:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783135354.737751:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135355.758885:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783135356.271185:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783135356.271193:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac6743ed800 from 4 10000000:01000000:0.0:1783135356.271198:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135356.271239:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135356.271252:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135356.271263:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135356.271288:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ec7a2d6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809040640:0@lo:101: 00000100:00100000:0.0:1783135356.271358:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135356.271420:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 00000000db5d0419 going to sleep for 11 seconds 00000100:00100000:2.0:1783135356.271639:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809040640 00000100:00100000:2.0:1783135356.271646:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809040640 00000100:00100000:2.0:1783135356.271816:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135356.271826:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007634db72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:6519:x1869752809040640:12345-0@lo:101: 00010000:00010000:2.0:1783135356.271842:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135356.271856:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000034988fd/0xf7de4ef628edf682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf67b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135356.271902:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000034988fd/0xf7de4ef628edf682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf67b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135356.271913:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000034988fd/0xf7de4ef628edf682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf67b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135356.271921:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000034988fd, rc 0) 00000100:00100000:2.0:1783135356.271969:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007634db72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:6519:x1869752809040640:12345-0@lo:101: Request processed in 145us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135356.271976:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135356.272058:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ec7a2d6c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809040640:0@lo:101: 00010000:00010000:3.0:1783135356.272073:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf67b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.272082:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf67b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135356.272156:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002bee53d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809040768:0@lo:256: 00000100:00100000:3.0:1783135356.272188:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.273129:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 000000003f8a7902 going to sleep for 11 seconds 00000100:00100000:0.0:1783135356.273176:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809040768 00000100:00100000:0.0:1783135356.273183:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809040768 00000100:00100000:0.0:1783135356.273217:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783135356.273224:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db6efc79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:6519:x1869752809040768:12345-0@lo:256: 20000000:01000000:0.0:1783135356.273244:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783135356.273264:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783135356.273267:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1783135356.273358:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db6efc79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:6519:x1869752809040768:12345-0@lo:256: Request processed in 134us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135356.273367:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783135356.275498:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002bee53d9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809040768:0@lo:256: 10000000:01000000:1.0:1783135356.275566:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135356.275576:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf67b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135356.275586:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000a78af296/0xf7de4ef628edf67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135356.275595:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783135356.275597:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac64382e000 from 21 10000000:01000000:1.0:1783135356.275599:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135356.275633:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000b38e9bdb/0xf7de4ef628edf689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135356.275649:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000b38e9bdb/0xf7de4ef628edf689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135356.275657:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000b38e9bdb/0xf7de4ef628edf689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135356.275813:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051515979 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809040896:0@lo:101: 00000100:00100000:1.0:1783135356.275874:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135356.275928:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 00000000210dfaed going to sleep for 11 seconds 00000100:00100000:1.0:1783135356.275958:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809040896 00000100:00100000:1.0:1783135356.275964:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809040896 00000100:00100000:1.0:1783135356.276005:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783135356.276012:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c99d94ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:6519:x1869752809040896:12345-0@lo:101: 00010000:00010000:1.0:1783135356.276024:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135356.276037:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ee7c60b/0xf7de4ef628edf690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf689 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135356.276058:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ee7c60b/0xf7de4ef628edf690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf689 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135356.276067:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ee7c60b/0xf7de4ef628edf690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf689 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135356.276075:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ee7c60b, rc 0) 00000100:00100000:1.0:1783135356.276147:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c99d94ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809040896:12345-0@lo:101: Request processed in 134us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135356.276154:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783135356.276200:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051515979 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809040896:0@lo:101: 00010000:00010000:1.0:1783135356.276219:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000b38e9bdb/0xf7de4ef628edf689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135356.276227:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000b38e9bdb/0xf7de4ef628edf689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135356.276280:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051515979 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041024:0@lo:501: 00000100:00100000:1.0:1783135356.276303:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135356.276315:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 00000000210dfaed going to sleep for 11 seconds 00000100:00100000:1.0:1783135356.276326:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809041024 00000100:00100000:1.0:1783135356.276328:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809041024 00000100:00100000:1.0:1783135356.276344:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783135356.276349:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dac889a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809041024:12345-0@lo:501: 00000100:00100000:1.0:1783135356.276758:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dac889a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809041024:12345-0@lo:501: Request processed in 409us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135356.276766:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783135356.277441:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051515979 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041024:0@lo:501: 00000100:00100000:3.0:1783135356.278318:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041152:0@lo:503: 00000100:00100000:3.0:1783135356.278386:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.279442:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 000000002fe04ca5 going to sleep for 11 seconds 00000100:00100000:0.0:1783135356.291175:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809041152 00000100:00100000:0.0:1783135356.291224:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809041152 00000100:00100000:0.0:1783135356.291551:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783135356.291567:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1239b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809041152:12345-0@lo:503: 00000100:00100000:0.0:1783135356.291738:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1239b3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809041152:12345-0@lo:503: Request processed in 179us (13352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135356.291746:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783135356.297956:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041152:0@lo:503: 00000100:00100000:0.0:1783135356.298472:0:7831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009f5d3c7a pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7831:1869752809041280:0@lo:502: 00000100:00100000:0.0:1783135356.298552:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135356.298594:0:7831:0:(client.c:2701:ptlrpc_set_wait()) set 00000000db5d0419 going to sleep for 11 seconds 00000100:00100000:3.0:1783135356.298754:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809041280 00000100:00100000:3.0:1783135356.298761:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809041280 00000100:00100000:3.0:1783135356.298812:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783135356.298821:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b48c12e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7831:x1869752809041280:12345-0@lo:502: 00000100:00100000:3.0:1783135356.298963:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b48c12e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7831:x1869752809041280:12345-0@lo:502: Request processed in 144us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.298971:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783135356.299733:0:7831:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009f5d3c7a pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7831:1869752809041280:0@lo:502: 00000100:00100000:0.0:1783135356.299797:0:7831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009f5d3c7a pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7831:1869752809041408:0@lo:502: 00000100:00100000:0.0:1783135356.299844:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135356.299874:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809041408 00000100:00100000:0.0:1783135356.299890:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809041408 00000100:00100000:0.0:1783135356.299930:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783135356.299936:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fbee4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7831:x1869752809041408:12345-0@lo:502: 00000100:00100000:0.0:1783135356.300017:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fbee4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:7831:x1869752809041408:12345-0@lo:502: Request processed in 81us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135356.300025:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783135356.300065:0:7831:0:(client.c:2701:ptlrpc_set_wait()) set 00000000db5d0419 going to sleep for 11 seconds 00000100:00100000:0.0:1783135356.300077:0:7831:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009f5d3c7a pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7831:1869752809041408:0@lo:502: 00000040:00080000:0.0:1783135356.300119:0:7831:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1783135356.300460:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1783135356.300482:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135356.300491:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000b38e9bdb/0xf7de4ef628edf689 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.300501:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000b38e9bdb/0xf7de4ef628edf689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135356.300511:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783135356.300513:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac64382e000 from 4 10000000:01000000:3.0:1783135356.300516:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783135356.300544:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.300564:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.300573:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135356.300596:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041536:0@lo:101: 00000100:00100000:3.0:1783135356.300624:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.300648:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a4666d5 going to sleep for 11 seconds 00000100:00100000:3.0:1783135356.300662:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809041536 00000100:00100000:3.0:1783135356.300666:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809041536 00000100:00100000:3.0:1783135356.300706:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783135356.300713:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5da4dbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809041536:12345-0@lo:101: 00010000:00010000:3.0:1783135356.300721:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135356.300731:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009716eac8/0xf7de4ef628edf69e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf697 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.300751:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009716eac8/0xf7de4ef628edf69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf697 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.300760:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009716eac8/0xf7de4ef628edf69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf697 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.300768:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009716eac8, rc 0) 00000100:00100000:3.0:1783135356.300793:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5da4dbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809041536:12345-0@lo:101: Request processed in 82us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.300799:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783135356.300831:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041536:0@lo:101: 00010000:00010000:3.0:1783135356.300842:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.300849:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135356.300917:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041664:0@lo:256: 00000100:00100000:3.0:1783135356.300947:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.300959:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a4666d5 going to sleep for 11 seconds 00000100:00100000:3.0:1783135356.300970:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809041664 00000100:00100000:3.0:1783135356.300973:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809041664 00000100:00100000:3.0:1783135356.300994:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783135356.301000:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bca66f15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809041664:12345-0@lo:256: 20000000:01000000:3.0:1783135356.301013:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783135356.301030:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783135356.301033:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1783135356.301141:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bca66f15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809041664:12345-0@lo:256: Request processed in 141us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.301148:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783135356.301178:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041664:0@lo:256: 10000000:01000000:3.0:1783135356.301216:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783135356.301220:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.301228:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000c4aef460/0xf7de4ef628edf697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135356.301235:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783135356.301237:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1783135356.301239:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783135356.301253:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000a864fc60/0xf7de4ef628edf6a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.301270:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000a864fc60/0xf7de4ef628edf6a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.301277:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000a864fc60/0xf7de4ef628edf6a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135356.301288:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041792:0@lo:101: 00000100:00100000:3.0:1783135356.301313:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.301332:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a4666d5 going to sleep for 11 seconds 00000100:00100000:3.0:1783135356.301342:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809041792 00000100:00100000:3.0:1783135356.301346:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809041792 00000100:00100000:3.0:1783135356.301364:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783135356.301369:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047c09bb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809041792:12345-0@lo:101: 00010000:00010000:3.0:1783135356.301375:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135356.301382:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000173f60b0/0xf7de4ef628edf6ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf6a5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.301395:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000173f60b0/0xf7de4ef628edf6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf6a5 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.301402:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000173f60b0/0xf7de4ef628edf6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf6a5 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.301408:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000173f60b0, rc 0) 00000100:00100000:3.0:1783135356.301430:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047c09bb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809041792:12345-0@lo:101: Request processed in 61us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.301435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783135356.301461:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041792:0@lo:101: 00010000:00010000:3.0:1783135356.301475:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000a864fc60/0xf7de4ef628edf6a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.301482:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000a864fc60/0xf7de4ef628edf6a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135356.301524:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041920:0@lo:501: 00000100:00100000:3.0:1783135356.301546:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.301556:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a4666d5 going to sleep for 11 seconds 00000100:00100000:3.0:1783135356.301566:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809041920 00000100:00100000:3.0:1783135356.301568:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809041920 00000100:00100000:3.0:1783135356.301589:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783135356.301595:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb5ba600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809041920:12345-0@lo:501: 00000100:00100000:3.0:1783135356.301711:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb5ba600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809041920:12345-0@lo:501: Request processed in 116us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.301718:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783135356.301743:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809041920:0@lo:501: 00000100:00100000:3.0:1783135356.301766:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809042048:0@lo:503: 00000100:00100000:3.0:1783135356.301801:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.301813:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 000000001a4666d5 going to sleep for 11 seconds 00000100:00100000:3.0:1783135356.301823:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809042048 00000100:00100000:3.0:1783135356.301826:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809042048 00000100:00100000:3.0:1783135356.301843:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783135356.301847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a74f5e98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809042048:12345-0@lo:503: 00000100:00100000:3.0:1783135356.301934:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a74f5e98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809042048:12345-0@lo:503: Request processed in 86us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.301940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783135356.301983:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809042048:0@lo:503: 00000100:00100000:3.0:1783135356.302213:0:7832:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7832:1869752809042176:0@lo:502: 00000100:00100000:3.0:1783135356.302247:0:7832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.302265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809042176 00000100:00100000:3.0:1783135356.302269:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809042176 00000100:00100000:3.0:1783135356.302289:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783135356.302295:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab3cb0c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:7832:x1869752809042176:12345-0@lo:502: 00000100:00100000:3.0:1783135356.302360:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab3cb0c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:7832:x1869752809042176:12345-0@lo:502: Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.302367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783135356.302401:0:7832:0:(client.c:2701:ptlrpc_set_wait()) set 00000000389d5d85 going to sleep for 11 seconds 00000100:00100000:3.0:1783135356.302412:0:7832:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7832:1869752809042176:0@lo:502: 00000020:01000000:3.0:1783135356.302430:0:7832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135356.302440:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135356.302442:0:7832:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783135356.302447:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783135356.302451:0:7832:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:00000080:3.0:1783135356.302470:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135356.302492:0:7832:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000b94120ea) 00000020:00000080:3.0:1783135356.302509:0:7832:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1783135356.302516:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783135356.302580:0:7832:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783135356.302585:0:7832:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783135356.302592:0:7832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628edf6ba 00010000:00080000:3.0:1783135356.302622:0:7832:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dcd82036@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:3.0:1783135356.307376:0:7832:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1783135356.328713:0:7832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783135356.328730:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783135356.328771:0:7832:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783135356.328794:0:7832:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628edf6c1 00000100:00080000:0.0:1783135356.328804:0:7832:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135356.328809:0:7832:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000dcd82036 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135356.328843:0:7832:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009f5d3c7a x1869752809042304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135356.328883:0:7832:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1783135356.328994:0:7832:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1783135356.329133:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000009f5d3c7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809042304:0@lo:38: 00000100:00100000:1.0:1783135356.329203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135356.330674:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007069971a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809042432:0@lo:400: 00000100:00100000:2.0:1783135356.330745:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135356.330786:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135356.330792:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ec7a2d6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809042560:0@lo:400: 00000100:00100000:2.0:1783135356.330815:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135356.330847:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135356.330854:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d6a5eece pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809042688:0@lo:400: 00000100:00100000:2.0:1783135356.330887:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135356.330940:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809042432 00000100:00100000:2.0:1783135356.330962:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809042432 00000100:00100000:1.0:1783135356.331179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809042688 00000100:00100000:1.0:1783135356.331184:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809042688 00000100:00100000:2.0:1783135356.331262:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135356.331271:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d5b20a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809042432:12345-0@lo:400: 00000100:00100000:2.0:1783135356.331327:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d5b20a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809042432:12345-0@lo:400: Request processed in 57us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135356.331334:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135356.331598:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809042304 00000100:00100000:0.0:1783135356.331604:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809042304 00000100:00100000:0.0:1783135356.331621:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809042560 00000100:00100000:0.0:1783135356.331624:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809042560 00000100:00100000:0.0:1783135356.331643:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135356.331647:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0061919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869752809042304:12345-0@lo:38: 00010000:00080000:0.0:1783135356.331672:0:6527:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:0.0:1783135356.331724:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628edf6c8 00000004:00100000:0.0:1783135356.331739:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1783135356.331753:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1783135356.331924:0:7832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135356.331931:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135356.331932:0:7832:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1783135356.331934:0:7832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135356.331937:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135356.331938:0:7832:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783135356.331941:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783135356.331942:0:7832:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783135356.331974:0:7832:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000002c65def7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7832:1869752809042816:0@lo:502: 00000100:00100000:0.0:1783135356.332024:0:7832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135356.332053:0:7832:0:(client.c:2701:ptlrpc_set_wait()) set 000000004c108cef going to sleep for 11 seconds 00000100:00080000:0.0:1783135356.332145:0:7836:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000001b564b8a x1869752809042944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135356.332154:0:7836:0:(client.c:2701:ptlrpc_set_wait()) set 00000000243e75ca going to sleep for 0 seconds 00000100:00100000:3.0:1783135356.332304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809042816 00000100:00100000:3.0:1783135356.332309:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809042816 00000100:00100000:3.0:1783135356.332364:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783135356.332371:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f00d909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:7832:x1869752809042816:12345-0@lo:502: 00000100:00100000:3.0:1783135356.332664:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f00d909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:7832:x1869752809042816:12345-0@lo:502: Request processed in 293us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.332671:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135356.332873:0:7832:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000002c65def7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:7832:1869752809042816:0@lo:502: 00000020:01000000:0.0:1783135356.332913:0:7832:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135356.332918:0:7832:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135356.332920:0:7832:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783135356.332924:0:7832:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1783135356.333125:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1783135356.333145:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783135356.333153:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000a864fc60/0xf7de4ef628edf6a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.333161:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000a864fc60/0xf7de4ef628edf6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135356.333170:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783135356.333173:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ac66b5899c0 from 1 10000000:01000000:3.0:1783135356.333175:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783135356.333198:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000a38086a5/0xf7de4ef628edf6cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.333205:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000a38086a5/0xf7de4ef628edf6cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.333213:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000a38086a5/0xf7de4ef628edf6cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135356.333225:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809043072:0@lo:101: 00000100:00100000:3.0:1783135356.333254:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.333278:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bca34871 going to sleep for 11 seconds 00000100:00100000:0.0:1783135356.333332:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809043072 00000100:00100000:0.0:1783135356.333337:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809043072 00000100:00100000:0.0:1783135356.333369:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135356.333375:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005b2b7e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809043072:12345-0@lo:101: 00010000:00010000:0.0:1783135356.333384:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135356.333408:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000314c6212/0xf7de4ef628edf6d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf6cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135356.333432:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000314c6212/0xf7de4ef628edf6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf6cf expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135356.333458:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000314c6212/0xf7de4ef628edf6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf6cf expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135356.333465:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000314c6212, rc 0) 00000100:00100000:0.0:1783135356.333493:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005b2b7e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809043072:12345-0@lo:101: Request processed in 119us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135356.333499:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783135356.334073:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809043072:0@lo:101: 00010000:00010000:3.0:1783135356.334345:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000a38086a5/0xf7de4ef628edf6cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.334356:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000a38086a5/0xf7de4ef628edf6cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135356.335187:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809043200:0@lo:501: 00000100:00100000:3.0:1783135356.335244:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.335326:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bca34871 going to sleep for 11 seconds 00000100:00100000:1.0:1783135356.335524:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135356.335534:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002c3731d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809042688:12345-0@lo:400: 00000100:00100000:1.0:1783135356.335586:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002c3731d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809042688:12345-0@lo:400: Request processed in 55us (4710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135356.335592:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783135356.335839:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007069971a x1869752809042432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135356.335853:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007069971a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809042432:0@lo:400: 00010000:00080000:2.0:1783135356.335897:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d6a5eece x1869752809042688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135356.335906:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d6a5eece pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809042688:0@lo:400: 00000100:00100000:0.0:1783135356.343189:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809043200 00000100:00100000:0.0:1783135356.343205:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809043200 00000100:00100000:3.0:1783135356.347278:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783135356.347289:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004eafa14a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809043200:12345-0@lo:501: 00000100:00100000:3.0:1783135356.347412:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004eafa14a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809043200:12345-0@lo:501: Request processed in 125us (12167us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783135356.347420:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783135356.347470:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809043200:0@lo:501: 10000000:01000000:3.0:1783135356.347510:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783135356.347519:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000a38086a5/0xf7de4ef628edf6cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135356.347529:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000a38086a5/0xf7de4ef628edf6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783135356.358201:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000f549fa65 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135356.358315:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0061919 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1869752809042304:12345-0@lo:38: Request processed in 26665us (29110us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.358326:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783135356.358354:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135356.358371:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038f9c51a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809042560:12345-0@lo:400: 00000100:00100000:3.0:1783135356.358435:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038f9c51a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809042560:12345-0@lo:400: Request processed in 67us (27619us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.358441:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135356.358581:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135356.358590:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783135356.358606:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783135356.358611:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783135356.358613:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000dcd82036 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1783135356.358628:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000243e75ca): req@000000001b564b8a x1869752809042944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135356.358642:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000009f5d3c7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809042304:0@lo:38: 00000100:00100000:1.0:1783135356.358711:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cd9a59f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809043328:0@lo:41: 00000100:00100000:1.0:1783135356.358747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135356.358870:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ec7a2d6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809042560:0@lo:400: 00000100:00100000:0.0:1783135356.358933:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135356.358944:0:7836:0:(client.c:2701:ptlrpc_set_wait()) set 00000000243e75ca going to sleep for 11 seconds 00000100:00100000:3.0:1783135356.359056:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809043328 00000100:00100000:3.0:1783135356.359063:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809043328 00000100:00100000:3.0:1783135356.359153:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809042944 00000100:00100000:3.0:1783135356.359157:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809042944 00000100:00100000:3.0:1783135356.359186:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135356.359192:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007995db37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1869752809043328:12345-0@lo:41: 00000004:00000024:3.0:1783135356.359218:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1783135356.359541:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007995db37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1869752809043328:12345-0@lo:41: Request processed in 349us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.359549:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135356.359564:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135356.359570:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec7a2d6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7836:x1869752809042944:12345-0@lo:1000: 00000100:00100000:3.0:1783135356.359635:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec7a2d6c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7836:x1869752809042944:12345-0@lo:1000: Request processed in 66us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.359642:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135356.360116:0:7836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001b564b8a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809042944:0@lo:1000: 00000040:01000000:0.0:1783135356.360151:0:7836:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1783135356.360187:0:7836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001b564b8a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809043456:0@lo:1000: 00000100:00100000:0.0:1783135356.360227:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135356.360246:0:7836:0:(client.c:2701:ptlrpc_set_wait()) set 00000000243e75ca going to sleep for 11 seconds 00000100:00100000:3.0:1783135356.360593:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809043456 00000100:00100000:3.0:1783135356.360599:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809043456 00000100:00100000:3.0:1783135356.360646:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135356.360654:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c65def7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7836:x1869752809043456:12345-0@lo:1000: 00000100:00100000:3.0:1783135356.360784:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c65def7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7836:x1869752809043456:12345-0@lo:1000: Request processed in 131us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.360791:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135356.360828:0:7836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001b564b8a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809043456:0@lo:1000: 00000100:00100000:3.0:1783135356.360898:0:7836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809043584:0@lo:700: 00000100:00100000:3.0:1783135356.361314:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.361340:0:7836:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bca34871 going to sleep for 11 seconds 00000100:00100000:0.0:1783135356.361404:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809043584 00000100:00100000:0.0:1783135356.361409:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809043584 00000100:00100000:0.0:1783135356.361453:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135356.361459:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4fdef59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7836:x1869752809043584:12345-0@lo:700: 00000100:00100000:0.0:1783135356.361501:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4fdef59 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7836:x1869752809043584:12345-0@lo:700: Request processed in 43us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135356.361509:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135356.362069:0:7836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809043584:0@lo:700: 00000100:00100000:3.0:1783135356.362283:0:7836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809043712:0@lo:1000: 00000100:00100000:3.0:1783135356.362321:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.362557:0:7836:0:(client.c:2701:ptlrpc_set_wait()) set 000000005a72c969 going to sleep for 11 seconds 00000100:00100000:0.0:1783135356.362864:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809043712 00000100:00100000:0.0:1783135356.362870:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809043712 00000100:00100000:0.0:1783135356.362936:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135356.362943:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e1a36ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7836:x1869752809043712:12345-0@lo:1000: 00000100:00100000:0.0:1783135356.363013:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e1a36ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7836:x1869752809043712:12345-0@lo:1000: Request processed in 71us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135356.363020:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135356.363172:0:7836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809043712:0@lo:1000: 00000004:00080000:3.0:1783135356.363220:0:7836:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000bca34871 with version 0 00000020:00100000:3.0:1783135356.363234:0:7836:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1783135356.363240:0:7836:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000062efb407 x1869752809043968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135356.363253:0:7836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809043968:0@lo:1000: 00000100:00100000:3.0:1783135356.363275:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135356.363295:0:7836:0:(client.c:2701:ptlrpc_set_wait()) set 00000000317d6834 going to sleep for 11 seconds 00000100:00100000:0.0:1783135356.364769:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809043968 00000100:00100000:0.0:1783135356.364779:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809043968 00000100:00100000:0.0:1783135356.364829:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783135356.364837:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f9c07b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7836:x1869752809043968:12345-0@lo:1000: 00000100:00100000:1.0:1783135356.365475:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cd9a59f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809043328:0@lo:41: 00000001:00080000:2.0:1783135356.368950:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1783135356.368964:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783135356.369558:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f9c07b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7836:x1869752809043968:12345-0@lo:1000: Request processed in 4707us (6267us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783135356.369579:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1783135356.370454:0:7836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1783135356.370464:0:7836:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783135356.370479:0:7836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000062efb407 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809043968:0@lo:1000: 00000100:00100000:1.0:1783135356.370699:0:7836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cd9a59f4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809044096:0@lo:1000: 00000100:00100000:1.0:1783135356.370754:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135356.370862:0:7836:0:(client.c:2701:ptlrpc_set_wait()) set 00000000210dfaed going to sleep for 11 seconds 00000100:00100000:0.0:1783135356.370927:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809044096 00000100:00100000:0.0:1783135356.370935:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809044096 00000100:00100000:0.0:1783135356.370986:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135356.370995:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000646a7c3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7836:x1869752809044096:12345-0@lo:1000: 00000100:00100000:0.0:1783135356.371114:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000646a7c3b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7836:x1869752809044096:12345-0@lo:1000: Request processed in 120us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135356.371122:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135356.371332:0:7836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cd9a59f4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7836:1869752809044096:0@lo:1000: 00000040:00080000:2.0:1783135356.371355:0:7836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1783135356.371387:0:7836:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000037e47136 with version 1 00000040:00080000:2.0:1783135356.373457:0:7836:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783135356.373535:0:7836:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783135356.373539:0:7836:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1783135356.373986:0:7833:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000389d5d85 version 1 rpc_version 1 00000020:00100000:0.0:1783135356.374029:0:7833:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1783135356.374038:0:7833:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a89f9dfc x1869752809044352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135356.374062:0:7833:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a89f9dfc pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7833:1869752809044352:0@lo:1000: 00000100:00100000:0.0:1783135356.374198:0:7833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135356.374236:0:7833:0:(client.c:2701:ptlrpc_set_wait()) set 00000000314260d8 going to sleep for 11 seconds 00000100:00100000:1.0:1783135356.374686:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809044352 00000100:00100000:1.0:1783135356.374706:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809044352 00000100:00100000:1.0:1783135356.374767:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135356.374775:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050d6532d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7833:x1869752809044352:12345-0@lo:1000: 00000001:00080000:2.0:1783135356.391029:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1783135356.391857:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050d6532d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7833:x1869752809044352:12345-0@lo:1000: Request processed in 17073us (17650us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783135356.391887:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1783135356.392969:0:7833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1783135356.392985:0:7833:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783135356.393009:0:7833:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a89f9dfc pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7833:1869752809044352:0@lo:1000: 00010000:00010000:0.0:1783135356.784226:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783135357.246071:0:7881:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135357.246802:0:7881:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783135357.807609:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135358.319309:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000934d26d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809044480:0@lo:41: 00000100:00100000:2.0:1783135358.319390:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135358.319483:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809044480 00000100:00100000:3.0:1783135358.319490:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809044480 00000100:00100000:3.0:1783135358.319542:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135358.319549:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1a9b24b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809044480:12345-0@lo:41: 00000004:00000024:3.0:1783135358.319584:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1783135358.320547:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1a9b24b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809044480:12345-0@lo:41: Request processed in 994us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135358.320558:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135358.326503:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000934d26d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809044480:0@lo:41: 00000020:00000080:3.0:1783135358.406143:0:7929:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbec6f930 20000000:00000080:3.0:1783135358.406159:0:7929:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac67c512400 uarg=0000000000000000 20000000:01000000:3.0:1783135358.406209:0:7929:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783135358.406220:0:7929:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783135358.406225:0:7929:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783135358.406376:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1783135358.406388:0:7929:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1783135358.410668:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135358.411149:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783135358.411184:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1783135358.411199:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1783135358.411213:0:7929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783135358.411231:0:7929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135358.411250:0:7929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000090de5818/0xf7de4ef628edf55c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf555 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135358.411256:0:7929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009216cd3f/0xf7de4ef628edf64a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf643 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135358.411262:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135358.411300:0:7929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009216cd3f/0xf7de4ef628edf64a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf643 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135358.411312:0:7929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009216cd3f/0xf7de4ef628edf64a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf643 expref: 17 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135358.411325:0:7929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000030530e21 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1869752809044608:0@lo:104: 00000100:00100000:3.0:1783135358.411392:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135358.411478:0:7929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000090de5818/0xf7de4ef628edf55c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf555 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135358.411485:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1783135358.411495:0:7929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000090de5818/0xf7de4ef628edf55c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf555 expref: 17 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135358.411499:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809044608 00000100:00100000:3.0:1783135358.411503:0:7929:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003ee8f04a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1869752809044736:0@lo:104: 00000100:00100000:1.0:1783135358.411510:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809044608 00000100:00100000:3.0:1783135358.411525:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135358.411540:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809044736 00000100:00100000:3.0:1783135358.411541:0:7929:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b8208358 going to sleep for 11 seconds 00000100:00100000:1.0:1783135358.411543:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809044736 00000100:00100000:1.0:1783135358.411556:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135358.411563:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002aff1dc8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:7929:x1869752809044608:12345-0@lo:104: 00010000:00010000:1.0:1783135358.411574:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411640:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135358.411645:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002aff1dc8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:7929:x1869752809044608:12345-0@lo:104: Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135358.411652:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135358.411689:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135358.411694:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067707b4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:7929:x1869752809044736:12345-0@lo:104: 00010000:00010000:1.0:1783135358.411700:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411727:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783135358.411731:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067707b4d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:7929:x1869752809044736:12345-0@lo:104: Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135358.411737:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1783135358.411753:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135358.411757:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411764:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000005a04a8d already unused, calling callback (0000000001e5aac5) 10000000:00010000:1.0:1783135358.411767:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411784:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135358.411790:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135358.411795:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135358.411821:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411827:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135358.411866:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411874:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 0000000005a04a8d/0xf7de4ef628edf643 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf64a expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411887:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135358.411889:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411894:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000def97f4 already unused, calling callback (0000000001e5aac5) 10000000:00010000:1.0:1783135358.411896:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411901:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135358.411906:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135358.411916:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135358.411930:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411934:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135358.411948:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411954:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 000000000def97f4/0xf7de4ef628edf555 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf55c expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.411965:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135358.411979:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135358.411980:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135358.411997:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a3b146fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809044864:0@lo:103: 00000100:00100000:1.0:1783135358.412026:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135358.412054:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000954262cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809044992:0@lo:103: 00000100:00100000:1.0:1783135358.412075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135358.412132:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809044864 00000100:00100000:1.0:1783135358.412136:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809044864 00010000:00010000:1.0:1783135358.412152:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009216cd3f/0xf7de4ef628edf64a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf643 expref: 18 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135358.412170:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809044992 00000100:00100000:1.0:1783135358.412172:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809044992 00010000:00010000:1.0:1783135358.412182:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000090de5818/0xf7de4ef628edf55c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf555 expref: 19 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135358.412193:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135358.412204:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a47d93cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:3649:x1869752809044864:12345-0@lo:103: 00010000:00010000:1.0:1783135358.412215:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135358.412219:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009216cd3f/0xf7de4ef628edf64a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf643 expref: 19 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412228:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009216cd3f/0xf7de4ef628edf64a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf643 expref: 19 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412242:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135358.412267:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a47d93cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:3649:x1869752809044864:12345-0@lo:103: Request processed in 64us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135358.412274:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135358.412286:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135358.412290:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000445c13b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:3646:x1869752809044992:12345-0@lo:103: 00010000:00010000:1.0:1783135358.412297:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135358.412300:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000090de5818/0xf7de4ef628edf55c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf555 expref: 18 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412308:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000090de5818/0xf7de4ef628edf55c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf555 expref: 18 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412318:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412324:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412336:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412352:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412357:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412363:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412368:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000be6ebcd3 already unused, calling callback (000000009f6c9720) 00010000:00010000:1.0:1783135358.412370:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412376:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412383:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.412392:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135358.412415:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000445c13b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:3646:x1869752809044992:12345-0@lo:103: Request processed in 125us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135358.412421:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1783135358.412445:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135358.412460:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000954262cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809044992:0@lo:103: 00000100:00100000:1.0:1783135358.412484:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a3b146fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809044864:0@lo:103: 00010000:00010000:3.0:1783135358.413617:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009216cd3f/0xf7de4ef628edf64a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf643 expref: 17 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135358.413636:0:7929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000030530e21 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1869752809044608:0@lo:104: 00010000:00010000:3.0:1783135358.413647:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000090de5818/0xf7de4ef628edf55c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf555 expref: 16 pid: 6516 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135358.413655:0:7929:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003ee8f04a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1869752809044736:0@lo:104: 00010000:00010000:3.0:1783135358.413674:0:7929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135358.413683:0:7929:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135358.413688:0:7929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135358.413692:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000be6ebcd3/0xf7de4ef628edf6dd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135358.831394:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135359.858778:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135360.881151:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135361.391925:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003c68fcf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809045120:0@lo:41: 00000100:00100000:1.0:1783135361.392070:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135361.392251:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809045120 00000100:00100000:2.0:1783135361.392259:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809045120 00000100:00100000:2.0:1783135361.392322:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135361.392332:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3b146fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809045120:12345-0@lo:41: 00000004:00000024:2.0:1783135361.392387:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1783135361.392453:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3b146fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809045120:12345-0@lo:41: Request processed in 122us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135361.392460:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135361.392757:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000659a52e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809045248:0@lo:400: 00000100:00100000:2.0:1783135361.392819:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135361.392858:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135361.392863:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a88d43e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809045376:0@lo:400: 00000100:00100000:2.0:1783135361.392886:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135361.392907:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008164db6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809045504:0@lo:400: 00000100:00100000:2.0:1783135361.392930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135361.392945:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135361.392949:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809045632:0@lo:400: 00000100:00100000:2.0:1783135361.392969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135361.392992:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809045248 00000100:00100000:2.0:1783135361.392995:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809045248 00000100:00100000:2.0:1783135361.393024:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783135361.393030:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005882a2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:3648:x1869752809045248:12345-0@lo:400: 00000100:00100000:2.0:1783135361.393061:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005882a2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:3648:x1869752809045248:12345-0@lo:400: Request processed in 32us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135361.393067:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783135361.393145:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809045376 00000100:00100000:2.0:1783135361.393149:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809045376 00000100:00100000:2.0:1783135361.393188:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809045632 00000100:00100000:2.0:1783135361.393192:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809045632 00000100:00100000:2.0:1783135361.393205:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135361.393210:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000810f93d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809045376:12345-0@lo:400: 00000100:00100000:2.0:1783135361.393240:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000810f93d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809045376:12345-0@lo:400: Request processed in 30us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135361.393246:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135361.393257:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135361.393262:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052dc1406 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809045632:12345-0@lo:400: 00000100:00100000:2.0:1783135361.393290:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052dc1406 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809045632:12345-0@lo:400: Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135361.393296:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1783135361.393328:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000265961d4 x1869752809045632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135361.393340:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000265961d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809045632:0@lo:400: 00010000:00080000:2.0:1783135361.393501:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a88d43e5 x1869752809045376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135361.393510:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a88d43e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809045376:0@lo:400: 00000100:00100000:2.0:1783135361.393519:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000659a52e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809045248:0@lo:400: 00000100:00100000:2.0:1783135361.393544:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809045504 00000100:00100000:2.0:1783135361.393547:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809045504 00000100:00100000:2.0:1783135361.393567:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135361.393573:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095d1ff2e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809045504:12345-0@lo:400: 00000100:00100000:2.0:1783135361.393610:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095d1ff2e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809045504:12345-0@lo:400: Request processed in 39us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135361.393626:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135361.393651:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008164db6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809045504:0@lo:400: 00000100:00100000:1.0:1783135361.393982:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003c68fcf6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809045120:0@lo:41: 00010000:00010000:0.0:1783135361.911894:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135362.929711:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135363.438950:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135363.438976:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000954262cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809045760:0@lo:41: 00000100:00100000:1.0:1783135363.439046:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135363.440174:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809045760 00000100:00100000:0.0:1783135363.440186:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809045760 00000100:00100000:0.0:1783135363.440305:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783135363.440313:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bd15417 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809045760:12345-0@lo:41: 00000004:00000024:0.0:1783135363.440350:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1783135363.440422:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bd15417 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809045760:12345-0@lo:41: Request processed in 110us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135363.440430:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783135363.440474:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000954262cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809045760:0@lo:41: 00010000:00010000:3.0:1783135363.951182:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135364.974291:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135365.999594:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783135366.513419:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135366.513427:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac6743ed800 from 1 10000000:01000000:1.0:1783135366.513432:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135366.513492:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 000000009b992a30/0xf7de4ef628edf6e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.513504:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 000000009b992a30/0xf7de4ef628edf6e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.513515:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 000000009b992a30/0xf7de4ef628edf6e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135366.513538:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f5f91e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809045888:0@lo:101: 00000100:00100000:1.0:1783135366.513611:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135366.513656:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 00000000882ded7a going to sleep for 11 seconds 00000100:00100000:1.0:1783135366.513679:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809045888 00000100:00100000:1.0:1783135366.513693:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809045888 00000100:00100000:3.0:1783135366.513709:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003ee8f04a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809046016:0@lo:41: 00000100:00100000:1.0:1783135366.513739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135366.513746:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e08d1870 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809045888:12345-0@lo:101: 00000100:00100000:3.0:1783135366.513760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135366.513760:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135366.513770:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000027f4d3ad/0xf7de4ef628edf6eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf6e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135366.513796:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809046016 00000100:00100000:3.0:1783135366.513799:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809046016 00010000:00010000:1.0:1783135366.513803:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000027f4d3ad/0xf7de4ef628edf6eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf6e4 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.513811:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000027f4d3ad/0xf7de4ef628edf6eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf6e4 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.513819:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000027f4d3ad, rc 0) 00000100:00100000:3.0:1783135366.513833:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135366.513839:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030530e21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809046016:12345-0@lo:41: 00000100:00100000:1.0:1783135366.513852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e08d1870 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809045888:12345-0@lo:101: Request processed in 107us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.513858:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00000024:3.0:1783135366.513862:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1783135366.513891:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030530e21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809046016:12345-0@lo:41: Request processed in 54us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.513896:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135366.513900:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f5f91e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809045888:0@lo:101: 00010000:00010000:1.0:1783135366.513912:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 000000009b992a30/0xf7de4ef628edf6e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.513920:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 000000009b992a30/0xf7de4ef628edf6e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135366.513924:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003ee8f04a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809046016:0@lo:41: 00000100:00100000:1.0:1783135366.513973:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f5f91e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809046144:0@lo:501: 00000100:00100000:1.0:1783135366.513997:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135366.514020:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 00000000882ded7a going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.514038:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809046144 00000100:00100000:3.0:1783135366.514042:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809046144 00000100:00100000:3.0:1783135366.514063:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783135366.514069:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005129d675 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809046144:12345-0@lo:501: 00000100:00100000:3.0:1783135366.514226:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005129d675 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809046144:12345-0@lo:501: Request processed in 157us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.514232:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135366.514306:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f5f91e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809046144:0@lo:501: 00000100:00100000:1.0:1783135366.514347:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008f5f91e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809046272:0@lo:503: 00000100:00100000:1.0:1783135366.514385:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135366.514412:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set 00000000882ded7a going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.514464:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809046272 00000100:00100000:3.0:1783135366.514468:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809046272 00000100:00100000:3.0:1783135366.514499:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135366.514506:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027ed596b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809046272:12345-0@lo:503: 00000100:00100000:3.0:1783135366.514594:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027ed596b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809046272:12345-0@lo:503: Request processed in 89us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.514600:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135366.514647:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008f5f91e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809046272:0@lo:503: 00000100:00100000:3.0:1783135366.514875:0:8299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003ee8f04a pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8299:1869752809046400:0@lo:502: 00000100:00100000:3.0:1783135366.514912:0:8299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.514930:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809046400 00000100:00100000:3.0:1783135366.514934:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809046400 00000100:00100000:3.0:1783135366.514957:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135366.514964:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000734166f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:8299:x1869752809046400:12345-0@lo:502: 00000100:00100000:3.0:1783135366.515027:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000734166f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:8299:x1869752809046400:12345-0@lo:502: Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.515034:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135366.515062:0:8299:0:(client.c:2701:ptlrpc_set_wait()) set 000000002528f930 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.515074:0:8299:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003ee8f04a pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8299:1869752809046400:0@lo:502: 00000020:01000000:3.0:1783135366.515127:0:8299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135366.515136:0:8299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135366.515139:0:8299:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783135366.515146:0:8299:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac6743ed800 00000020:00000080:3.0:1783135366.515149:0:8299:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783135366.515188:0:8299:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8299:1869752809046528:0@lo:502: 00000100:00100000:3.0:1783135366.515220:0:8299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.515237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809046528 00000100:00100000:3.0:1783135366.515241:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809046528 00000100:00100000:3.0:1783135366.515262:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783135366.515269:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:8299:x1869752809046528:12345-0@lo:502: 00000100:00100000:3.0:1783135366.515325:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:8299:x1869752809046528:12345-0@lo:502: Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.515331:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783135366.515362:0:8299:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bcea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.515374:0:8299:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8299:1869752809046528:0@lo:502: 00000020:01000000:3.0:1783135366.515388:0:8299:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135366.515397:0:8299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135366.515399:0:8299:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783135366.515402:0:8299:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1783135366.515455:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783135366.515472:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135366.515479:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a000/0xf7de4ef628edf6e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.515488:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a000/0xf7de4ef628edf6e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135366.515497:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135366.515499:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac64382e000 from 1 10000000:01000000:3.0:1783135366.515501:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135366.515521:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.515527:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.515536:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135366.515545:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809046656:0@lo:101: 00000100:00100000:3.0:1783135366.515569:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.515580:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bcea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.515590:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809046656 00000100:00100000:3.0:1783135366.515593:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809046656 00000100:00100000:3.0:1783135366.515612:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783135366.515618:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809046656:12345-0@lo:101: 00010000:00010000:3.0:1783135366.515626:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135366.515641:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edf6f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf6f2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.515657:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edf6f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf6f2 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.515667:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edf6f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf6f2 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.515675:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527000, rc 0) 00000100:00100000:3.0:1783135366.515713:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809046656:12345-0@lo:101: Request processed in 95us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.515718:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783135366.515744:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809046656:0@lo:101: 00010000:00010000:3.0:1783135366.515753:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.515762:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135366.515796:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809046784:0@lo:501: 00000100:00100000:3.0:1783135366.515819:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.515842:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bcea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135366.515882:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809046784 00000100:00100000:0.0:1783135366.515886:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809046784 00000100:00100000:0.0:1783135366.515912:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783135366.515918:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809046784:12345-0@lo:501: 00000100:00100000:0.0:1783135366.516003:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809046784:12345-0@lo:501: Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135366.516009:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783135366.516969:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809046912:0@lo:400: 00000100:00100000:1.0:1783135366.517019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135366.517044:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135366.517050:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809047040:0@lo:400: 00000100:00100000:1.0:1783135366.517074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135366.517120:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809046912 00000100:00100000:1.0:1783135366.517125:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809046912 00000100:00100000:1.0:1783135366.517158:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135366.517165:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809046912:12345-0@lo:400: 00000100:00100000:1.0:1783135366.517203:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809046912:12345-0@lo:400: Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.517209:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1783135366.517242:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac67b190000 x1869752809046912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135366.517255:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809046912:0@lo:400: 00000100:00100000:3.0:1783135366.519126:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809047168:0@lo:400: 00000100:00100000:3.0:1783135366.519187:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.519239:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809047040 00000100:00100000:3.0:1783135366.519245:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809047040 00000100:00100000:3.0:1783135366.519841:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135366.519859:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809047040:12345-0@lo:400: 00000100:00100000:3.0:1783135366.520136:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809047040:12345-0@lo:400: Request processed in 286us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.520143:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135366.520194:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809046784:0@lo:501: 00000100:00100000:3.0:1783135366.520246:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809047296:0@lo:503: 00000100:00100000:3.0:1783135366.520843:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.520891:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bcea0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.520911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809047296 00000100:00100000:3.0:1783135366.520916:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809047296 00000100:00100000:3.0:1783135366.520969:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783135366.520978:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809047296:12345-0@lo:503: 00000100:00100000:3.0:1783135366.521073:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809047296:12345-0@lo:503: Request processed in 96us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.521079:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783135366.521153:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809047296:0@lo:503: 00000100:00100000:3.0:1783135366.521343:0:8300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8300:1869752809047424:0@lo:502: 00000100:00100000:3.0:1783135366.521388:0:8300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.521406:0:8300:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bcea600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135366.521986:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809047040:0@lo:400: 00000100:00100000:1.0:1783135366.524873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809047168 00000100:00100000:1.0:1783135366.524890:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809047168 00000100:00100000:1.0:1783135366.524963:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135366.524973:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809047168:12345-0@lo:400: 00000100:00100000:1.0:1783135366.525070:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809047168:12345-0@lo:400: Request processed in 100us (5883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.525078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135366.525120:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809047424 00000100:00100000:1.0:1783135366.525124:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809047424 00000100:00100000:1.0:1783135366.525149:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783135366.525155:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:8300:x1869752809047424:12345-0@lo:502: 00010000:00080000:0.0:1783135366.525160:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac67b193480 x1869752809047168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135366.525177:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809047168:0@lo:400: 00000100:00100000:1.0:1783135366.525287:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:8300:x1869752809047424:12345-0@lo:502: Request processed in 131us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.525300:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135366.525312:0:8300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8300:1869752809047424:0@lo:502: 00000020:01000000:0.0:1783135366.525340:0:8300:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135366.525350:0:8300:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135366.525357:0:8300:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783135366.525365:0:8300:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac64382e000 00000020:00000080:0.0:1783135366.525368:0:8300:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783135366.525410:0:8300:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8300:1869752809047552:0@lo:502: 00000100:00100000:0.0:1783135366.525463:0:8300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.525499:0:8300:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac65807a900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135366.525598:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809047552 00000100:00100000:2.0:1783135366.525603:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809047552 00000100:00100000:2.0:1783135366.525637:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783135366.525645:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:8300:x1869752809047552:12345-0@lo:502: 00000100:00100000:2.0:1783135366.525730:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:8300:x1869752809047552:12345-0@lo:502: Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135366.525737:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783135366.525854:0:8300:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8300:1869752809047552:0@lo:502: 00000020:01000000:0.0:1783135366.525873:0:8300:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135366.525877:0:8300:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135366.525879:0:8300:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783135366.525883:0:8300:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1783135366.526062:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783135366.526082:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135366.526127:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.526139:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135367.030684:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135368.046651:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135368.558434:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135368.558465:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809047680:0@lo:41: 00000100:00100000:0.0:1783135368.558555:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135368.559002:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809047680 00000100:00100000:1.0:1783135368.559011:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809047680 00000100:00100000:1.0:1783135368.559070:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135368.559080:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809047680:12345-0@lo:41: 00000004:00000024:1.0:1783135368.559151:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1783135368.559201:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809047680:12345-0@lo:41: Request processed in 122us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135368.559208:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135368.559301:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809047680:0@lo:41: 00010000:00010000:1.0:1783135369.070716:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135369.313767:0:8429:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783135369.313771:0:8429:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1783135369.313773:0:8429:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783135369.313914:0:8429:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ac67c2fd800 00000020:01000004:1.0:1783135369.313931:0:8429:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783135369.313945:0:8429:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783135369.313959:0:8429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ac67c1699c0) 00000020:00000080:1.0:1783135369.313974:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783135369.396562:0:8429:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783135369.396646:0:8429:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1783135369.450322:0:8429:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783135369.450521:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783135369.450532:0:8429:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783135369.450544:0:8429:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7de4ef628edf707 00000020:01000004:0.0:1783135369.450551:0:8429:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783135369.450572:0:8429:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.106@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783135369.450576:0:8429:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783135369.450582:0:8429:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783135369.450602:0:8429:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783135369.450613:0:8429:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ac67b4bcd40) 00000020:00000080:0.0:1783135369.450625:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1783135369.454549:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135369.460022:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783135369.460034:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783135369.476078:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783135369.476128:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1783135369.482472:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1783135369.482487:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783135369.487186:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135369.487364:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783135369.487371:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783135369.489067:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783135369.489083:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783135369.519517:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135369.520009:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783135369.520018:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783135369.526492:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783135369.526521:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783135369.528797:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783135369.528810:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783135369.533743:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135369.534387:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135369.534396:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783135369.535476:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135369.535488:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783135369.648015:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135369.648225:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135369.648233:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783135369.653509:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783135369.653527:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783135369.654400:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783135369.654446:0:8429:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1783135369.654452:0:8429:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1783135369.685605:0:8429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783135369.685656:0:8429:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.106@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1783135369.685660:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783135369.685662:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135369.685663:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135369.685664:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135369.685665:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135369.685667:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135369.685668:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135369.685670:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783135369.685671:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783135369.685673:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135369.685674:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135369.685677:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1783135369.685679:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135369.685681:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135369.685682:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135369.685683:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135369.685684:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135369.685685:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135369.685686:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135369.685688:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783135369.685689:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783135369.685690:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135369.685691:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135369.685735:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783135369.685754:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b192680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809047808:0@lo:253: 00000100:00100000:1.0:1783135369.686376:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.686444:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642b540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135369.686608:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809047808 00000100:00100000:2.0:1783135369.686618:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809047808 00000100:00100000:2.0:1783135369.686696:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783135369.686706:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:8429:x1869752809047808:12345-0@lo:253: 20000000:01000000:2.0:1783135369.686748:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783135369.686752:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1783135369.686757:0:6515:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1783135369.686760:0:6515:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1783135369.686979:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135369.687184:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1783135369.687212:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1783135369.687713:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1783135369.687725:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1783135369.687743:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1783135369.687759:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1783135369.687845:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1783135369.687859:0:6515:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.106@tcp 20000000:01000000:2.0:1783135369.687861:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:2.0:1783135369.687874:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1783135369.687880:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783135369.687894:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1783135369.687900:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:2.0:1783135369.687913:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1783135369.687920:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783135369.687933:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1783135369.687949:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1783135369.688012:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1783135369.688023:0:6515:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.106@tcp 20000000:01000000:2.0:1783135369.688025:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:2.0:1783135369.688038:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1783135369.688044:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783135369.688057:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1783135369.688062:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:2.0:1783135369.688074:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1783135369.688079:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783135369.688130:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1783135369.688148:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1783135369.691605:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1783135369.691652:0:6515:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.106@tcp 20000000:01000000:2.0:1783135369.691655:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:2.0:1783135369.691808:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1783135369.691824:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783135369.691841:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1783135369.691846:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:2.0:1783135369.691859:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1783135369.691867:0:6515:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1783135369.691880:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1783135369.691893:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1783135369.691910:0:6515:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783135369.691913:0:6515:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783135369.691918:0:6515:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783135369.691964:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783135369.691967:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783135369.692762:0:8448:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1783135369.692800:0:8448:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1783135369.692818:0:8448:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1783135369.693423:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1783135369.693449:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1783135369.693465:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1783135369.693476:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783135369.693478:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783135369.695334:0:8449:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1783135369.695382:0:8449:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1783135369.695400:0:8449:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1783135369.695817:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1783135369.695838:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1783135369.695852:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1783135369.695861:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783135369.695864:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783135369.697313:0:8450:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1783135369.704473:0:8450:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1783135369.705690:0:8450:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1783135369.705978:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1783135369.706004:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1783135369.706018:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1783135369.706029:0:6515:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783135369.706031:0:6515:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783135369.707463:0:8451:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1783135369.707958:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1783135369.708011:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1783135369.708028:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1783135369.708043:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783135369.708061:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.708117:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac6413e8a00/0xf7de4ef628edf5e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf5da expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.708125:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac6413e8c00/0xf7de4ef628edf658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf651 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.708132:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac6413e9c00/0xf7de4ef628edf690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf689 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.708138:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac682173000/0xf7de4ef628edf6ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf6a5 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.708144:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf6cf expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.708151:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.708367:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf6cf expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.708382:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf6d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf6cf expref: 18 pid: 6517 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.708397:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643475180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869752809047936:0@lo:104: 00000100:00100000:2.0:1783135369.708456:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135369.708847:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac682173000/0xf7de4ef628edf6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf6a5 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.708858:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac682173000/0xf7de4ef628edf6ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf6a5 expref: 18 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.708876:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869752809048064:0@lo:104: 00000100:00100000:2.0:1783135369.708902:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135369.709115:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac6413e9c00/0xf7de4ef628edf690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf689 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.709124:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac6413e9c00/0xf7de4ef628edf690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf689 expref: 18 pid: 6517 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.709133:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643475c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869752809048192:0@lo:104: 00000100:00100000:2.0:1783135369.709156:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135369.710757:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac6413e8c00/0xf7de4ef628edf658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf651 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.710772:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac6413e8c00/0xf7de4ef628edf658 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf651 expref: 18 pid: 6516 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.710783:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869752809048320:0@lo:104: 00000100:00100000:2.0:1783135369.710826:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.710987:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809047936 00000100:00100000:3.0:1783135369.710995:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809047936 00000100:00100000:3.0:1783135369.711036:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809048064 00000100:00100000:3.0:1783135369.711039:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809048064 00000100:00100000:3.0:1783135369.711049:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809048192 00000100:00100000:3.0:1783135369.711052:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809048192 00000100:00100000:3.0:1783135369.711065:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135369.711074:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:6515:x1869752809047936:12345-0@lo:104: 00010000:00010000:3.0:1783135369.711410:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac682172a00/0xf7de4ef628edf6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.711466:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783135369.711472:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:6515:x1869752809047936:12345-0@lo:104: Request processed in 399us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.711480:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135369.711512:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783135369.711521:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6515:x1869752809048064:12345-0@lo:104: 00010000:00010000:3.0:1783135369.711528:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628edf6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.711559:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783135369.711563:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6515:x1869752809048064:12345-0@lo:104: Request processed in 45us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.711593:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783135369.711606:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135369.711613:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643477b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6515:x1869752809048192:12345-0@lo:104: 00010000:00010000:3.0:1783135369.711620:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac6413e9800/0xf7de4ef628edf689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.711955:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783135369.711962:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643477b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6515:x1869752809048192:12345-0@lo:104: Request processed in 350us (2805us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.711969:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135369.711981:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809048320 00000100:00100000:3.0:1783135369.711985:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809048320 00000100:00100000:3.0:1783135369.712001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135369.712006:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6515:x1869752809048320:12345-0@lo:104: 00010000:00010000:3.0:1783135369.712013:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac650989800/0xf7de4ef628edf651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.712449:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac6413e8a00/0xf7de4ef628edf5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf5da expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.712460:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac6413e8a00/0xf7de4ef628edf5e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf5da expref: 18 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.712471:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869752809048448:0@lo:104: 00000100:00100000:2.0:1783135369.714908:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135369.715026:0:6515:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135369.715055:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643475180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869752809047936:0@lo:104: 00000100:00100000:2.0:1783135369.715081:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869752809048064:0@lo:104: 00000100:00100000:2.0:1783135369.715115:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643475c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869752809048192:0@lo:104: 00010000:00010000:3.0:1783135369.715355:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783135369.715364:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6515:x1869752809048320:12345-0@lo:104: Request processed in 3356us (4536us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.715374:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135369.715409:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809048448 00000100:00100000:3.0:1783135369.715416:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809048448 00000100:00100000:3.0:1783135369.715449:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135369.715457:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6515:x1869752809048448:12345-0@lo:104: 00010000:00010000:3.0:1783135369.715474:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.715523:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1783135369.715529:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6515:x1869752809048448:12345-0@lo:104: Request processed in 73us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.715536:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1783135369.715556:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1783135369.715562:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac682172a00/0xf7de4ef628edf6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.716341:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869752809048320:0@lo:104: 00000100:00100000:2.0:1783135369.716352:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6515:1869752809048448:0@lo:104: 00010000:00010000:2.0:1783135369.716382:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.716450:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172a00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135369.716457:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac682172a00/0xf7de4ef628edf6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.716466:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac682172a00/0xf7de4ef628edf6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135369.716472:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac682172a00/0xf7de4ef628edf6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135369.716478:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135369.716601:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac682172a00/0xf7de4ef628edf6cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.716608:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135369.716642:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac682172a00/0xf7de4ef628edf6cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.716650:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac682172a00/0xf7de4ef628edf6cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6d6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.716688:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783135369.716692:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628edf6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.716699:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135369.716702:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628edf6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.716708:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628edf6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135369.716714:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628edf6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135369.716720:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783135369.716748:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135369.716763:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809048576:0@lo:103: 00000100:00100000:1.0:1783135369.716807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.716848:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809048576 00000100:00100000:1.0:1783135369.716853:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809048576 00010000:00010000:1.0:1783135369.716881:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf6d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf6cf expref: 19 pid: 6517 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135369.716905:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135369.716925:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:3647:x1869752809048576:12345-0@lo:103: 00010000:00010000:1.0:1783135369.716935:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135369.716941:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf6d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf6cf expref: 19 pid: 6517 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.716951:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf6cf expref: 19 pid: 6517 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.716965:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf6d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf6cf expref: 19 pid: 6517 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.716978:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135369.717006:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:3647:x1869752809048576:12345-0@lo:103: Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.717013:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135369.717057:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809048576:0@lo:103: 00010000:00010000:2.0:1783135369.717905:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783135369.718555:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135369.718885:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac6413e9800/0xf7de4ef628edf689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.718896:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9800 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135369.718900:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac6413e9800/0xf7de4ef628edf689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.718908:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac6413e9800/0xf7de4ef628edf689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135369.718927:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac6413e9800/0xf7de4ef628edf689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135369.718932:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135369.718970:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac6413e9800/0xf7de4ef628edf689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.718976:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135369.718993:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac6413e9800/0xf7de4ef628edf689 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.718999:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac6413e9800/0xf7de4ef628edf689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf690 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719012:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135369.719015:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719020:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031c00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135369.719023:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719028:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135369.719034:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135369.719038:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135369.719057:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf5da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719062:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135369.719076:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf5da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719082:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf5da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf5e1 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719118:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135369.719119:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135369.719121:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135369.719128:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135369.719143:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809048704:0@lo:103: 00000100:00100000:1.0:1783135369.719235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.719286:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809048832:0@lo:103: 00000100:00100000:1.0:1783135369.719310:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.719341:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809048704 00000100:00100000:1.0:1783135369.719347:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809048704 00010000:00010000:1.0:1783135369.719369:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac6413e9c00/0xf7de4ef628edf690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf689 expref: 18 pid: 6517 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135369.719389:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809048832 00000100:00100000:1.0:1783135369.719391:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809048832 00010000:00010000:1.0:1783135369.719402:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac6413e8a00/0xf7de4ef628edf5e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf5da expref: 19 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135369.719414:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135369.719422:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:3646:x1869752809048704:12345-0@lo:103: 00010000:00010000:1.0:1783135369.719443:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135369.719449:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac6413e9c00/0xf7de4ef628edf690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf689 expref: 19 pid: 6517 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719460:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac6413e9c00/0xf7de4ef628edf690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf689 expref: 19 pid: 6517 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719474:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac6413e9c00/0xf7de4ef628edf690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf689 expref: 19 pid: 6517 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719486:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135369.719519:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:3646:x1869752809048704:12345-0@lo:103: Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.719526:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135369.719543:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135369.719550:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:3648:x1869752809048832:12345-0@lo:103: 00010000:00010000:1.0:1783135369.719557:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135369.719562:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac6413e8a00/0xf7de4ef628edf5e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf5da expref: 17 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719859:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac6413e8a00/0xf7de4ef628edf5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf5da expref: 17 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719875:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac6413e8a00/0xf7de4ef628edf5e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf5da expref: 17 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.719885:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135369.719918:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:3648:x1869752809048832:12345-0@lo:103: Request processed in 368us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.719924:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135369.719970:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809048832:0@lo:103: 00000100:00100000:1.0:1783135369.720003:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b193480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809048704:0@lo:103: 00010000:00010000:3.0:1783135369.720488:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628edf6a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.720496:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135369.720518:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628edf6a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.720525:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628edf6a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.720539:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135369.720541:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135369.720543:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135369.720779:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809048960:0@lo:103: 00000100:00100000:2.0:1783135369.720817:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.721037:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809048960 00000100:00100000:3.0:1783135369.721050:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809048960 00010000:00010000:3.0:1783135369.721074:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac682173000/0xf7de4ef628edf6ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf6a5 expref: 16 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135369.721139:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135369.721147:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:3649:x1869752809048960:12345-0@lo:103: 00010000:00010000:3.0:1783135369.721157:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135369.721161:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac682173000/0xf7de4ef628edf6ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf6a5 expref: 16 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.721170:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac682173000/0xf7de4ef628edf6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf6a5 expref: 16 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.721183:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac682173000/0xf7de4ef628edf6ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf6a5 expref: 16 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.721194:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135369.721412:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3649:x1869752809048960:12345-0@lo:103: Request processed in 265us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.721419:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1783135369.721475:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135369.721478:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135369.721479:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135369.721511:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac650989800/0xf7de4ef628edf651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.721520:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989800 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135369.721523:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac650989800/0xf7de4ef628edf651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.721532:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac650989800/0xf7de4ef628edf651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135369.721538:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac650989800/0xf7de4ef628edf651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135369.721543:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783135369.721604:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809048960:0@lo:103: 00010000:00010000:0.0:1783135369.722560:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac650989800/0xf7de4ef628edf651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.722580:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135369.722608:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac650989800/0xf7de4ef628edf651 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.722635:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac650989800/0xf7de4ef628edf651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf658 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.722653:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135369.722655:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135369.722657:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135369.722979:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135369.722995:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809049088:0@lo:103: 00000100:00100000:3.0:1783135369.723047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135369.723204:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809049088 00000100:00100000:0.0:1783135369.723210:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809049088 00010000:00010000:0.0:1783135369.723245:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac6413e8c00/0xf7de4ef628edf658 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf651 expref: 15 pid: 6516 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135369.723269:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135369.723278:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65807e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3647:x1869752809049088:12345-0@lo:103: 00010000:00010000:0.0:1783135369.723288:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135369.723293:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac6413e8c00/0xf7de4ef628edf658 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf651 expref: 15 pid: 6516 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723303:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac6413e8c00/0xf7de4ef628edf658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf651 expref: 15 pid: 6516 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723315:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac6413e8c00/0xf7de4ef628edf658 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf651 expref: 15 pid: 6516 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723330:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723338:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723366:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723373:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723379:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723386:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723392:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135369.723396:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723404:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723427:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.723438:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135369.723473:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65807e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:3647:x1869752809049088:12345-0@lo:103: Request processed in 195us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.723481:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1783135369.723755:0:6515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.723763:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.723776:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650988000/0xf7de4ef628edf715 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783135369.723789:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783135369.723844:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809049088:0@lo:103: 00000100:00100000:0.0:1783135369.728388:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:8429:x1869752809047808:12345-0@lo:253: Request processed in 41673us (42002us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.728404:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783135369.728507:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b192680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809047808:0@lo:253: 10000000:01000000:1.0:1783135369.728524:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783135369.728528:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135369.728530:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135369.728531:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135369.728533:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1783135369.728534:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135369.728535:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135369.728537:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135369.728538:0:8429:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783135369.728540:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135369.728541:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783135369.728564:0:8429:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ac67c2fd800 from lustre-OST0000 10000000:01000000:1.0:1783135369.728739:0:8429:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783135369.728743:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783135369.728751:0:8429:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ac66b5899c0 local copy 10000000:01000000:1.0:1783135369.728755:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783135369.728793:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.728804:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.728812:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135369.728830:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049216:0@lo:101: 00000100:00100000:1.0:1783135369.728991:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.729076:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642b626c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135369.729384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809049216 00000100:00100000:2.0:1783135369.729391:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809049216 00000100:00100000:2.0:1783135369.729442:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783135369.729451:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:8429:x1869752809049216:12345-0@lo:101: 00010000:00010000:2.0:1783135369.729465:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135369.729478:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf71c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.729499:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf71c expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.729509:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf71c expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.729519:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988400, rc 0) 00000100:00100000:2.0:1783135369.729783:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809049216:12345-0@lo:101: Request processed in 332us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135369.729790:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783135369.729986:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049216:0@lo:101: 00010000:00010000:1.0:1783135369.730002:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.730011:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135369.730151:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049344:0@lo:501: 00000100:00100000:1.0:1783135369.730179:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.730203:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642b626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135369.730513:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809049344 00000100:00100000:0.0:1783135369.730531:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809049344 00000100:00100000:0.0:1783135369.730568:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135369.730585:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809049344:12345-0@lo:501: 00000100:00100000:0.0:1783135369.730670:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809049344:12345-0@lo:501: Request processed in 85us (489us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135369.730677:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783135369.731358:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049344:0@lo:501: 10000000:01000000:1.0:1783135369.731376:0:8429:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783135369.731398:0:8429:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783135369.731403:0:8429:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.731412:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.731419:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.731442:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783135369.731464:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ac67c2fd800 10000000:01000000:1.0:1783135369.731468:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783135369.731473:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783135369.731476:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135369.731480:0:8429:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783135369.731490:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783135369.731510:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.731518:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.731527:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135369.731540:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049472:0@lo:101: 00010000:00010000:2.0:1783135369.731666:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135369.731673:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.731681:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51be00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:2.0:1783135369.731684:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.731693:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135369.731701:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135369.731706:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783135369.731724:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.731730:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135369.731754:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.731761:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf71c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7de4ef628edf723 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.731772:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135369.731774:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135369.731775:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135369.731871:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809049600:0@lo:103: 00000100:00100000:3.0:1783135369.731900:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135369.732063:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809049600 00000100:00100000:2.0:1783135369.732069:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809049600 00000100:00100000:2.0:1783135369.732143:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135369.732151:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:3647:x1869752809049600:12345-0@lo:103: 00010000:00010000:2.0:1783135369.732162:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135369.732175:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf71c expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.732189:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135369.732231:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:3647:x1869752809049600:12345-0@lo:103: Request processed in 80us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135369.732238:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135369.732260:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809049600:0@lo:103: 00000100:00100000:1.0:1783135369.732387:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.732406:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642b62840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135369.732446:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809049472 00000100:00100000:3.0:1783135369.732450:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809049472 00000100:00100000:3.0:1783135369.732481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783135369.732487:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+13:8429:x1869752809049472:12345-0@lo:101: 00010000:00010000:3.0:1783135369.732496:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135369.732507:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf72a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.732523:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf72a expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.732533:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf72a expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.732539:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527400, rc 0) 00000100:00100000:3.0:1783135369.732578:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809049472:12345-0@lo:101: Request processed in 85us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.732583:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783135369.732792:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049472:0@lo:101: 00010000:00010000:2.0:1783135369.732804:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.732813:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.732945:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049728:0@lo:501: 00000100:00100000:2.0:1783135369.732969:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135369.732993:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823180 going to sleep for 11 seconds 00000100:00100000:3.0:1783135369.733365:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809049728 00000100:00100000:3.0:1783135369.733370:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809049728 00000100:00100000:3.0:1783135369.733410:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783135369.733416:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809049728:12345-0@lo:501: 00000100:00100000:3.0:1783135369.733798:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809049728:12345-0@lo:501: Request processed in 380us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.733806:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135369.734071:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049728:0@lo:501: 00000100:00100000:2.0:1783135369.734148:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049856:0@lo:503: 00000100:00100000:2.0:1783135369.734195:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.734331:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809049856 00000100:00100000:3.0:1783135369.734336:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809049856 00000100:00100000:3.0:1783135369.734365:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783135369.734371:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809049856:12345-0@lo:503: 00000100:00100000:3.0:1783135369.734445:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809049856:12345-0@lo:503: Request processed in 73us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.734451:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783135369.735069:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135369.739776:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049856:0@lo:503: 00000040:00080000:3.0:1783135369.740747:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135369.740923:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049984:0@lo:502: 00000100:00100000:3.0:1783135369.741007:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.741134:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135369.741425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809049984 00000100:00100000:0.0:1783135369.741433:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809049984 00000100:00100000:0.0:1783135369.741856:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783135369.741868:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809049984:12345-0@lo:502: 00000100:00100000:0.0:1783135369.742054:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809049984:12345-0@lo:502: Request processed in 188us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.742061:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783135369.742465:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809049984:0@lo:502: 00000040:00080000:1.0:1783135369.743856:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783135369.743904:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783135369.743919:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783135369.743933:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783135369.743946:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783135369.743959:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783135369.744000:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050112:0@lo:502: 00000100:00100000:1.0:1783135369.744071:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.744142:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642b62180 going to sleep for 11 seconds 00000100:00100000:3.0:1783135369.744340:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809050112 00000100:00100000:3.0:1783135369.744348:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809050112 00000100:00100000:3.0:1783135369.744398:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783135369.744407:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809050112:12345-0@lo:502: 00000100:00100000:3.0:1783135369.744528:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809050112:12345-0@lo:502: Request processed in 121us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.744535:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783135369.744774:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050112:0@lo:502: 00000040:00080000:1.0:1783135369.744827:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1783135369.744836:0:8429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1783135369.746035:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783135369.746045:0:8454:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1783135369.746052:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135369.746054:0:8454:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783135369.746061:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135369.746114:0:8454:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ac541dc19c0) 00000020:00000080:0.0:1783135369.746137:0:8454:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783135369.746144:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783135369.746286:0:8454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac67c2fd800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783135369.746295:0:8454:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783135369.746302:0:8454:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7de4ef628edf73f 00010000:00010000:3.0:1783135369.760998:0:8454:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1783135369.761399:0:8454:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1783135369.763734:0:8454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783135369.764078:0:8454:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1783135369.778396:0:8454:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1783135369.778844:0:8454:0:(osd_compat.c:1271:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1783135369.795206:0:8454:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1783135369.809364:0:8454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783135369.809377:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135369.813830:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135369.813838:0:8454:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783135369.813847:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135369.813853:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135369.813854:0:8454:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135369.813858:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135369.813860:0:8454:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783135369.813886:0:8454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135369.813889:0:8454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135369.813890:0:8454:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783135369.813893:0:8454:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783135369.814069:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1783135369.814132:0:8429:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783135369.814153:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.814165:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135369.814173:0:8429:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac67c2fd800 from 1 10000000:01000000:0.0:1783135369.814176:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135369.814222:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.814231:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.814242:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135369.814266:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050240:0@lo:101: 00000100:00100000:0.0:1783135369.814334:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135369.814375:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646dd8180 going to sleep for 11 seconds 00000100:00100000:3.0:1783135369.814501:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809050240 00000100:00100000:3.0:1783135369.814509:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809050240 00000100:00100000:3.0:1783135369.814554:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783135369.814563:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809050240:12345-0@lo:101: 00010000:00010000:3.0:1783135369.814597:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135369.814609:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edf74d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf746 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.814643:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edf74d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf746 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.814654:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edf74d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf746 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.814672:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526600, rc 0) 00000100:00100000:3.0:1783135369.814714:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8429:x1869752809050240:12345-0@lo:101: Request processed in 152us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.814721:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783135369.814771:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050240:0@lo:101: 00010000:00010000:3.0:1783135369.814786:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.814794:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135369.814873:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050368:0@lo:501: 00000100:00100000:3.0:1783135369.814911:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.814929:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135369.815118:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809050368 00000100:00100000:0.0:1783135369.815123:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809050368 00000100:00100000:0.0:1783135369.815148:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783135369.815154:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8429:x1869752809050368:12345-0@lo:501: 00000100:00100000:0.0:1783135369.815253:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8429:x1869752809050368:12345-0@lo:501: Request processed in 99us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.815260:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783135369.816371:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050368:0@lo:501: 00000100:00100000:3.0:1783135369.816428:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050496:0@lo:503: 00000100:00100000:3.0:1783135369.816476:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.816515:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135369.816599:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809050496 00000100:00100000:0.0:1783135369.816610:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809050496 00000100:00100000:0.0:1783135369.816651:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783135369.816805:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8429:x1869752809050496:12345-0@lo:503: 00000100:00100000:0.0:1783135369.816906:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8429:x1869752809050496:12345-0@lo:503: Request processed in 248us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.816913:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783135369.816990:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050496:0@lo:503: 00000040:00080000:3.0:1783135369.817246:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135369.817310:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050624:0@lo:502: 00000100:00100000:3.0:1783135369.817338:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.817356:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135369.817546:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809050624 00000100:00100000:0.0:1783135369.817551:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809050624 00000100:00100000:0.0:1783135369.817582:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783135369.817588:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8429:x1869752809050624:12345-0@lo:502: 00000100:00100000:0.0:1783135369.817776:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8429:x1869752809050624:12345-0@lo:502: Request processed in 187us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.817783:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783135369.817976:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050624:0@lo:502: 00000040:00080000:2.0:1783135369.818489:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783135369.818518:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783135369.818543:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050752:0@lo:502: 00000100:00100000:2.0:1783135369.818770:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135369.818799:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135369.818838:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809050752 00000100:00100000:0.0:1783135369.818843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809050752 00000100:00100000:0.0:1783135369.818877:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783135369.818885:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8429:x1869752809050752:12345-0@lo:502: 00000100:00100000:0.0:1783135369.818966:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8429:x1869752809050752:12345-0@lo:502: Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.818972:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783135369.819068:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050752:0@lo:502: 00000040:00080000:2.0:1783135369.819276:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783135369.819286:0:8429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783135369.820232:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135369.820241:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135369.820243:0:8458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783135369.820251:0:8458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac67c2fd800 00000020:00000080:0.0:1783135369.820253:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135369.820263:0:8458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135369.820265:0:8458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135369.820266:0:8458:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783135369.820269:0:8458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783135369.821056:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783135369.821084:0:8429:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135369.821143:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.821155:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135369.821225:0:8429:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783135369.821228:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ac67c2fd800 10000000:01000000:2.0:1783135369.821231:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ac67c2fd800 10000000:01000000:2.0:1783135369.821236:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135369.821242:0:8429:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac67c2fd800 from 1 10000000:01000000:2.0:1783135369.821245:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135369.821278:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.821286:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.821297:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.821318:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050880:0@lo:101: 00000100:00100000:2.0:1783135369.821373:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135369.821409:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6608236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135369.821792:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809050880 00000100:00100000:0.0:1783135369.821799:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809050880 00000100:00100000:0.0:1783135369.821843:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783135369.821852:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8429:x1869752809050880:12345-0@lo:101: 00010000:00010000:0.0:1783135369.821865:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135369.821878:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf75b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf754 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.821902:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf754 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.821912:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf754 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.821921:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640031200, rc 0) 00000100:00100000:0.0:1783135369.821961:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:8429:x1869752809050880:12345-0@lo:101: Request processed in 110us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.821968:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783135369.822044:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809050880:0@lo:101: 00010000:00010000:3.0:1783135369.822059:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.822067:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135369.822170:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809051008:0@lo:501: 00000100:00100000:3.0:1783135369.822195:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.822225:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135369.822336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809051008 00000100:00100000:0.0:1783135369.822340:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809051008 00000100:00100000:0.0:1783135369.822361:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783135369.822366:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:8429:x1869752809051008:12345-0@lo:501: 00000100:00100000:0.0:1783135369.822446:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:8429:x1869752809051008:12345-0@lo:501: Request processed in 79us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.822452:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783135369.822525:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809051008:0@lo:501: 00000100:00100000:3.0:1783135369.822551:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809051136:0@lo:503: 00000100:00100000:3.0:1783135369.822596:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.822616:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135369.822785:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809051136 00000100:00100000:2.0:1783135369.822790:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809051136 00000100:00100000:2.0:1783135369.822820:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783135369.822826:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:8429:x1869752809051136:12345-0@lo:503: 00000100:00100000:2.0:1783135369.822893:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:8429:x1869752809051136:12345-0@lo:503: Request processed in 68us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135369.822900:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783135369.822975:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809051136:0@lo:503: 00000040:00080000:3.0:1783135369.823201:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135369.823275:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809051264:0@lo:502: 00000100:00100000:3.0:1783135369.823302:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.823316:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135369.823438:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809051264 00000100:00100000:0.0:1783135369.823442:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809051264 00000100:00100000:0.0:1783135369.823462:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783135369.823469:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:8429:x1869752809051264:12345-0@lo:502: 00000100:00100000:0.0:1783135369.823544:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:8429:x1869752809051264:12345-0@lo:502: Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.823550:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783135369.823787:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809051264:0@lo:502: 00000040:00080000:3.0:1783135369.823976:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783135369.824004:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783135369.824015:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783135369.824026:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783135369.824038:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783135369.824050:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783135369.824061:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783135369.824072:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783135369.824116:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783135369.824133:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783135369.824145:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783135369.824157:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783135369.824169:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783135369.824194:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783135369.824209:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783135369.825843:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783135369.825861:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783135369.825874:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783135369.825887:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783135369.825899:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783135369.825911:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783135369.825924:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783135369.825936:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783135369.825950:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783135369.825964:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1783135369.825977:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1783135369.825990:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1783135369.826003:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1783135369.826018:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1783135369.826054:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1783135369.826069:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1783135369.826081:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1783135369.826132:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1783135369.826146:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1783135369.826159:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1783135369.826172:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1783135369.826185:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1783135369.827035:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809051392:0@lo:502: 00000100:00100000:3.0:1783135369.827152:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.827193:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135369.827527:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809051392 00000100:00100000:0.0:1783135369.827536:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809051392 00000100:00100000:0.0:1783135369.827597:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783135369.827607:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:8429:x1869752809051392:12345-0@lo:502: 00000100:00100000:0.0:1783135369.827894:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:8429:x1869752809051392:12345-0@lo:502: Request processed in 288us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.827902:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135369.828004:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809051392:0@lo:502: 00000040:00080000:3.0:1783135369.828074:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1783135369.828134:0:8429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1783135369.834486:0:8459:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783135369.834513:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ac67c16cd40) 00000020:00000080:1.0:1783135369.834539:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1783135369.835444:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac67c2fd800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783135369.835451:0:8459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac67c2fd800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783135369.835454:0:8459:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac67c2fd800 3 00010000:00080000:1.0:1783135369.835488:0:8459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac5424bf000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1783135369.839015:0:8459:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1783135369.839155:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783135369.839203:0:8459:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783135369.839217:0:8459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf7de4ef628edf769 00000100:00080000:1.0:1783135369.839229:0:8459:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135369.839235:0:8459:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ac5424bf000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135369.839270:0:8459:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac541d9b800 x1869752809051520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135369.839300:0:8459:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783135369.839401:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809051648:0@lo:400: 00000100:00100000:1.0:1783135369.839463:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.839494:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135369.839500:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809051776:0@lo:400: 00000100:00100000:1.0:1783135369.839525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.839558:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809051648 00000100:00100000:1.0:1783135369.839565:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809051648 00000100:00100000:1.0:1783135369.839608:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135369.839617:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809051648:12345-0@lo:400: 00000100:00100000:0.0:1783135369.840180:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869752809051520:0@lo:38: 00000100:00100000:0.0:1783135369.840218:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135369.840262:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809051904:0@lo:400: 00000100:00100000:0.0:1783135369.840285:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135369.840297:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135369.840303:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809052032:0@lo:400: 00000100:00100000:0.0:1783135369.840323:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135369.840349:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783135369.840356:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783135369.840375:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809051776 00000100:00100000:0.0:1783135369.840379:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809051776 00000100:00100000:0.0:1783135369.840400:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809052032 00000100:00100000:0.0:1783135369.840403:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809052032 00000100:00100000:0.0:1783135369.840417:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135369.840423:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809051776:12345-0@lo:400: 00000100:00100000:0.0:1783135369.840477:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809051776:12345-0@lo:400: Request processed in 53us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.840499:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135369.840515:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783135369.840521:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809052032:12345-0@lo:400: 00000100:00100000:0.0:1783135369.840554:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809052032:12345-0@lo:400: Request processed in 34us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.840560:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783135369.843388:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809051776:0@lo:400: 00000100:00100000:0.0:1783135369.843443:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809052032:0@lo:400: 00000100:00100000:1.0:1783135369.844131:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809051648:12345-0@lo:400: Request processed in 4510us (4663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.844144:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135369.844171:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809051520 00000100:00100000:1.0:1783135369.844178:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809051520 00000100:00100000:1.0:1783135369.844198:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809051904 00000100:00100000:1.0:1783135369.844214:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809051904 00000100:00100000:1.0:1783135369.844239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135369.844247:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809051904:12345-0@lo:400: 00000100:00100000:1.0:1783135369.844285:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809051904:12345-0@lo:400: Request processed in 39us (3998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.844292:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135369.844304:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135369.844309:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869752809051520:12345-0@lo:38: 00010000:00080000:1.0:1783135369.844329:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:1.0:1783135369.844374:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf7de4ef628edf770 00000004:00100000:1.0:1783135369.844391:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783135369.844424:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135369.844473:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869752809051520:12345-0@lo:38: Request processed in 163us (4254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.844480:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783135369.844542:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac541d9b800 x1869752809051520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135369.844552:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135369.844560:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00010000:00080000:0.0:1783135369.844856:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac541d98e00 x1869752809051648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135369.844868:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809051648:0@lo:400: 00010000:00080000:0.0:1783135369.844899:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac541d98700 x1869752809051904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135369.844908:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809051904:0@lo:400: 00000100:00080000:1.0:1783135369.844944:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783135369.844951:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783135369.844954:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783135369.844960:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869752809051520:0@lo:38: 00000020:01000004:1.0:1783135369.846434:0:8459:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783135369.846453:0:8459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ac67c168000) 00000020:00000080:1.0:1783135369.846476:0:8459:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1783135369.846701:0:8459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac67c2fd800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783135369.846705:0:8459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac67c2fd800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783135369.846707:0:8459:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac67c2fd800 3 00010000:00080000:1.0:1783135369.846733:0:8459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac5424b8000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1783135369.858435:0:8459:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1783135369.858541:0:8459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1783135369.858602:0:8459:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783135369.858618:0:8459:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf7de4ef628edf77e 00000100:00080000:1.0:1783135369.858637:0:8459:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135369.858644:0:8459:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ac5424b8000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135369.858801:0:8459:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac541d9b800 x1869752809052160/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135369.858848:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869752809052160:0@lo:38: 00000100:00100000:1.0:1783135369.858925:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.858987:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809052160 00000100:00100000:1.0:1783135369.858995:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809052160 00000100:00100000:1.0:1783135369.859025:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135369.859033:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869752809052160:12345-0@lo:38: 00010000:00080000:1.0:1783135369.859058:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:1.0:1783135369.859128:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf7de4ef628edf785 00000004:00100000:1.0:1783135369.859145:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783135369.859175:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135369.859224:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869752809052160:12345-0@lo:38: Request processed in 190us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.859230:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783135369.859269:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac541d9b800 x1869752809052160/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135369.859288:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135369.859295:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1783135369.859302:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783135369.859306:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783135369.859308:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac5424b8000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783135369.859313:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869752809052160:0@lo:38: 00000100:00080000:1.0:1783135369.859330:0:8459:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1783135369.861942:0:8459:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1783135369.862129:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1783135369.862158:0:8429:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135369.862179:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.862191:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783135369.862240:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783135369.862243:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783135369.862244:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135369.862245:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135369.862246:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135369.862248:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135369.862249:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135369.862250:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135369.862252:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135369.862253:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135369.862255:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135369.862258:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1783135369.862260:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135369.862262:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783135369.862267:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135369.862268:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135369.862269:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135369.862270:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135369.862271:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135369.862272:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135369.862272:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135369.862273:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135369.862274:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135369.862299:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783135369.862318:0:8429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809052288:0@lo:253: 00000100:00100000:3.0:1783135369.862381:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.862418:0:8429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135369.862440:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809052288 00000100:00100000:3.0:1783135369.862447:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809052288 00000100:00100000:3.0:1783135369.862488:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783135369.862497:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:8429:x1869752809052288:12345-0@lo:253: 20000000:01000000:3.0:1783135369.862522:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783135369.862535:0:6517:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783135369.879276:0:6517:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783135369.879352:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783135369.883195:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783135369.883206:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783135369.883234:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.883267:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac650989c00/0xf7de4ef628edf682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf67b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.883276:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac682172800/0xf7de4ef628edf69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf697 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.883284:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.883325:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac682172800/0xf7de4ef628edf69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf697 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.883340:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac682172800/0xf7de4ef628edf69e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf697 expref: 16 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.883354:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d92300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809052416:0@lo:104: 00000100:00100000:2.0:1783135369.883423:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135369.883483:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac650989c00/0xf7de4ef628edf682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf67b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.883491:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac650989c00/0xf7de4ef628edf682 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf67b expref: 16 pid: 6516 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.883499:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809052544:0@lo:104: 00000100:00100000:2.0:1783135369.883517:0:6538:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135369.883596:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783135369.883614:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.883665:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809052416 00000100:00100000:3.0:1783135369.883672:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809052416 00000100:00100000:3.0:1783135369.883710:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809052544 00000100:00100000:3.0:1783135369.883713:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809052544 00000100:00100000:3.0:1783135369.883729:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135369.883737:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c170c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6538:x1869752809052416:12345-0@lo:104: 00010000:00010000:3.0:1783135369.883751:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac682172e00/0xf7de4ef628edf697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.883805:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783135369.883811:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c170c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6538:x1869752809052416:12345-0@lo:104: Request processed in 75us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.883828:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135369.883880:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135369.883886:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6538:x1869752809052544:12345-0@lo:104: 00010000:00010000:3.0:1783135369.883894:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac640031600/0xf7de4ef628edf67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.883927:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783135369.883932:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6538:x1869752809052544:12345-0@lo:104: Request processed in 47us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.883937:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1783135369.883953:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135369.883959:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac682172e00/0xf7de4ef628edf697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.883966:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172e00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135369.883969:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac682172e00/0xf7de4ef628edf697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.883977:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac682172e00/0xf7de4ef628edf697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135369.883984:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac682172e00/0xf7de4ef628edf697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135369.883989:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135369.884028:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac682172e00/0xf7de4ef628edf697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.884035:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135369.884060:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac682172e00/0xf7de4ef628edf697 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.884068:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac682172e00/0xf7de4ef628edf697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf69e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.884084:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135369.884114:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac640031600/0xf7de4ef628edf67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.884120:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135369.884123:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031600/0xf7de4ef628edf67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.884129:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac640031600/0xf7de4ef628edf67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135369.884135:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031600/0xf7de4ef628edf67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135369.884140:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135369.884154:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac640031600/0xf7de4ef628edf67b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.884159:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135369.884164:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac640031600/0xf7de4ef628edf67b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.884171:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac640031600/0xf7de4ef628edf67b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf682 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.884184:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135369.884193:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135369.884195:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135369.884201:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135369.884214:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809052672:0@lo:103: 00000100:00100000:3.0:1783135369.884243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.884263:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135369.884268:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809052800:0@lo:103: 00000100:00100000:3.0:1783135369.884286:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135369.884862:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809052672 00000100:00100000:2.0:1783135369.884870:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809052672 00010000:00010000:2.0:1783135369.884896:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac682172800/0xf7de4ef628edf69e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf697 expref: 17 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.884942:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809052800 00000100:00100000:2.0:1783135369.884946:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809052800 00010000:00010000:2.0:1783135369.884958:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac650989c00/0xf7de4ef628edf682 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf67b expref: 18 pid: 6516 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.884970:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135369.884976:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:3648:x1869752809052672:12345-0@lo:103: 00010000:00010000:2.0:1783135369.884987:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135369.884993:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac682172800/0xf7de4ef628edf69e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf697 expref: 18 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885003:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac682172800/0xf7de4ef628edf69e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf697 expref: 18 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885021:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135369.885066:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b598380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:3648:x1869752809052672:12345-0@lo:103: Request processed in 90us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135369.885073:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135369.885110:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135369.885116:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:3648:x1869752809052800:12345-0@lo:103: 00010000:00010000:2.0:1783135369.885124:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135369.885127:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac650989c00/0xf7de4ef628edf682 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf67b expref: 17 pid: 6516 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885135:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac650989c00/0xf7de4ef628edf682 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf67b expref: 17 pid: 6516 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885147:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885160:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135369.885175:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006974325s 00010000:00010000:2.0:1783135369.885180:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885187:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885193:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885199:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885204:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988800 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135369.885208:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885214:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885222:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885232:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135369.885255:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:3648:x1869752809052800:12345-0@lo:103: Request processed in 138us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135369.885261:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135369.885307:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809052800:0@lo:103: 00000100:00100000:2.0:1783135369.885316:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809052672:0@lo:103: 00010000:00010000:2.0:1783135369.885350:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac682172800/0xf7de4ef628edf69e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf697 expref: 16 pid: 6515 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.885363:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d92300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809052416:0@lo:104: 00010000:00010000:2.0:1783135369.885371:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650989c00/0xf7de4ef628edf682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf67b expref: 15 pid: 6516 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.885379:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809052544:0@lo:104: 00010000:00010000:2.0:1783135369.885391:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885400:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885406:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.885412:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650988800/0xf7de4ef628edf78c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135369.885564:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:8429:x1869752809052288:12345-0@lo:253: Request processed in 23067us (23181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.885583:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783135369.885895:0:8429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8429:1869752809052288:0@lo:253: 10000000:01000000:2.0:1783135369.885905:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783135369.885909:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135369.885910:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135369.885912:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135369.885913:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135369.885914:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135369.885921:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135369.885922:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135369.885923:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783135369.885925:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783135369.885926:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135369.885927:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783135369.885938:0:8429:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783135369.904431:0:8429:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1783135369.904836:0:8429:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1783135369.905033:0:8429:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1783135369.909230:0:8429:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1783135369.909564:0:8429:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1783135369.911212:0:8429:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1783135369.931756:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1783135369.950358:0:8429:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783135369.950369:0:8429:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783135369.950409:0:8429:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783135369.950461:0:8429:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783135369.950480:0:8429:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783135369.950503:0:8429:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1783135369.951324:0:8429:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135369.951508:0:8429:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1783135370.094776:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135371.123560:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783135371.243505:0:8517:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135371.244885:0:8517:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783135371.632163:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135371.632192:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809052928:0@lo:41: 00000100:00100000:0.0:1783135371.632277:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135371.632349:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809052928 00000100:00100000:0.0:1783135371.632357:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809052928 00000100:00100000:0.0:1783135371.632410:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783135371.632419:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809052928:12345-0@lo:41: 00000004:00000024:0.0:1783135371.632458:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1783135371.634241:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809052928:12345-0@lo:41: Request processed in 1814us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135371.634257:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783135371.634338:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809052928:0@lo:41: 00010000:00010000:1.0:1783135372.144802:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135373.180317:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783135373.614225:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783135373.614234:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac6743ed800 from 30 10000000:01000000:1.0:1783135373.614239:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135373.614283:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.614293:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.614303:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135373.614327:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053056:0@lo:101: 00000100:00100000:1.0:1783135373.614418:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.614670:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6753549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.614928:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809053056 00000100:00100000:0.0:1783135373.614937:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809053056 00000100:00100000:0.0:1783135373.614992:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783135373.615002:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:6519:x1869752809053056:12345-0@lo:101: 00010000:00010000:0.0:1783135373.615017:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135373.615032:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac640030600/0xf7de4ef628edf79a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf793 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.615057:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac640030600/0xf7de4ef628edf79a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf793 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.615068:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac640030600/0xf7de4ef628edf79a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf793 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.615077:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030600, rc 0) 00000100:00100000:0.0:1783135373.615221:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809053056:12345-0@lo:101: Request processed in 219us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.615228:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783135373.615287:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053056:0@lo:101: 00010000:00010000:0.0:1783135373.615302:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.615311:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135373.617308:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053184:0@lo:501: 00000100:00100000:0.0:1783135373.620136:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135373.620207:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6586f3840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135373.620391:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809053184 00000100:00100000:1.0:1783135373.620400:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809053184 00000100:00100000:1.0:1783135373.620462:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783135373.620471:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809053184:12345-0@lo:501: 00000100:00100000:1.0:1783135373.620664:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809053184:12345-0@lo:501: Request processed in 194us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135373.620671:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783135373.620946:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053184:0@lo:501: 00000100:00100000:2.0:1783135373.620999:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053312:0@lo:503: 00000100:00100000:2.0:1783135373.621056:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.621081:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6528ecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135373.621124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809053312 00000100:00100000:2.0:1783135373.621129:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809053312 00000100:00100000:2.0:1783135373.621160:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783135373.621167:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809053312:12345-0@lo:503: 00000100:00100000:2.0:1783135373.621254:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809053312:12345-0@lo:503: Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.621261:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783135373.621304:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053312:0@lo:503: 00000100:00100000:2.0:1783135373.621550:0:8600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8600:1869752809053440:0@lo:502: 00000100:00100000:2.0:1783135373.621605:0:8600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.621623:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809053440 00000100:00100000:2.0:1783135373.621626:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809053440 00000100:00100000:2.0:1783135373.621647:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783135373.621654:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8600:x1869752809053440:12345-0@lo:502: 00000100:00100000:2.0:1783135373.621729:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8600:x1869752809053440:12345-0@lo:502: Request processed in 75us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.621752:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783135373.621779:0:8600:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6528ec840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135373.621791:0:8600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8600:1869752809053440:0@lo:502: 00000100:00100000:2.0:1783135373.621826:0:8600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8600:1869752809053568:0@lo:502: 00000100:00100000:2.0:1783135373.621854:0:8600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.621869:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809053568 00000100:00100000:2.0:1783135373.621872:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809053568 00000100:00100000:2.0:1783135373.621900:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783135373.621917:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8600:x1869752809053568:12345-0@lo:502: 00000100:00100000:2.0:1783135373.621974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:8600:x1869752809053568:12345-0@lo:502: Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.621981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783135373.622014:0:8600:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6467c3540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135373.622026:0:8600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8600:1869752809053568:0@lo:502: 00000040:00080000:2.0:1783135373.622054:0:8600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783135373.622128:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783135373.622148:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135373.622158:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135373.622168:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135373.622177:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783135373.622179:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac6743ed800 from 5 10000000:01000000:2.0:1783135373.622182:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135373.622208:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135373.622222:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135373.622232:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135373.622245:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053696:0@lo:101: 00000100:00100000:2.0:1783135373.622270:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.622282:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6467c3540 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.624113:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809053696 00000100:00100000:0.0:1783135373.624126:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809053696 00000100:00100000:0.0:1783135373.624184:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783135373.624194:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809053696:12345-0@lo:101: 00010000:00010000:0.0:1783135373.624222:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135373.624240:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac640030e00/0xf7de4ef628edf7a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf7a1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.624264:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac640030e00/0xf7de4ef628edf7a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf7a1 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.624275:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac640030e00/0xf7de4ef628edf7a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf7a1 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.624283:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030e00, rc 0) 00000100:00100000:0.0:1783135373.624368:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809053696:12345-0@lo:101: Request processed in 174us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.624374:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783135373.624426:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053696:0@lo:101: 00010000:00010000:0.0:1783135373.624444:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.624454:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135373.624540:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053824:0@lo:256: 00000100:00100000:0.0:1783135373.624586:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135373.624615:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6586f33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.624628:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809053824 00000100:00100000:0.0:1783135373.624632:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809053824 00000100:00100000:0.0:1783135373.624653:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783135373.624660:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809053824:12345-0@lo:256: 20000000:01000000:0.0:1783135373.624672:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783135373.624687:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783135373.624691:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1783135373.624761:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809053824:12345-0@lo:256: Request processed in 100us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.624767:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783135373.624795:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053824:0@lo:256: 10000000:01000000:0.0:1783135373.624833:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135373.624840:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.624848:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135373.624857:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783135373.624859:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1783135373.624862:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783135373.624879:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.624896:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.624905:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135373.624917:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053952:0@lo:101: 00000100:00100000:0.0:1783135373.624941:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135373.624954:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6586f33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.625190:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809053952 00000100:00100000:0.0:1783135373.625194:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809053952 00000100:00100000:0.0:1783135373.625215:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783135373.625221:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809053952:12345-0@lo:101: 00010000:00010000:0.0:1783135373.625228:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135373.625237:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac640031600/0xf7de4ef628edf7b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf7af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.625251:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac640031600/0xf7de4ef628edf7b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf7af expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.625259:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac640031600/0xf7de4ef628edf7b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf7af expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.625266:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640031600, rc 0) 00000100:00100000:0.0:1783135373.625292:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809053952:12345-0@lo:101: Request processed in 71us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135373.639898:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809053952:0@lo:101: 00010000:00010000:1.0:1783135373.639932:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.639946:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135373.640039:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809054080:0@lo:501: 00000100:00100000:1.0:1783135373.640248:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.640296:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.640352:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783135373.640389:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809054080 00000100:00100000:0.0:1783135373.640407:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809054080 00000100:00100000:0.0:1783135373.640454:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783135373.640462:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809054080:12345-0@lo:501: 00000100:00100000:0.0:1783135373.640625:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809054080:12345-0@lo:501: Request processed in 162us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.640633:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783135373.640663:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809054080:0@lo:501: 00000100:00100000:0.0:1783135373.640695:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809054208:0@lo:503: 00000100:00100000:0.0:1783135373.640734:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135373.640757:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.640773:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809054208 00000100:00100000:0.0:1783135373.640776:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809054208 00000100:00100000:0.0:1783135373.640801:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783135373.640807:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809054208:12345-0@lo:503: 00000100:00100000:0.0:1783135373.640876:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809054208:12345-0@lo:503: Request processed in 69us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.640882:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783135373.640910:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809054208:0@lo:503: 00000100:00100000:1.0:1783135373.641656:0:8602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8602:1869752809054336:0@lo:502: 00000100:00100000:1.0:1783135373.641703:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.641749:0:8602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.642115:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809054336 00000100:00100000:0.0:1783135373.642122:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809054336 00000100:00100000:0.0:1783135373.642161:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783135373.642169:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:8602:x1869752809054336:12345-0@lo:502: 00000100:00100000:0.0:1783135373.642285:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:8602:x1869752809054336:12345-0@lo:502: Request processed in 115us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.642291:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783135373.642518:0:8602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8602:1869752809054336:0@lo:502: 00000020:01000000:2.0:1783135373.642566:0:8602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783135373.642575:0:8602:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1783135373.642582:0:8602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135373.642584:0:8602:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783135373.642590:0:8602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783135373.642593:0:8602:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:2.0:1783135373.642616:0:8602:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1783135373.642618:0:8602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135373.642632:0:8602:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8ac66b588000) 00000020:00000080:2.0:1783135373.642652:0:8602:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1783135373.642659:0:8602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783135373.642734:0:8602:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1783135373.642741:0:8602:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783135373.642748:0:8602:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628edf7c4 00010000:00080000:2.0:1783135373.642775:0:8602:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac542771800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.106@tcp at head 00010000:00010000:2.0:1783135373.643056:0:8602:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1783135373.657550:0:8602:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1783135373.657583:0:8602:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1783135373.657789:0:8602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135373.658042:0:8602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135373.658168:0:8602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1783135373.658255:0:8602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783135373.662886:0:8603:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135373.662893:0:8603:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783135373.664377:0:8602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783135373.664390:0:8602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783135373.664841:0:8602:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783135373.666295:0:8602:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628edf7cb 00000100:00080000:0.0:1783135373.666318:0:8602:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135373.666324:0:8602:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ac542771800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135373.666361:0:8602:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac6434f7480 x1869752809054464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135373.666388:0:8602:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1783135373.667384:0:8602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135373.667392:0:8602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135373.667394:0:8602:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783135373.667398:0:8602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135373.667402:0:8602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135373.667404:0:8602:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783135373.667407:0:8602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783135373.667409:0:8602:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783135373.667436:0:8602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8602:1869752809055360:0@lo:502: 00000100:00100000:1.0:1783135373.667875:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809054592:0@lo:400: 00000100:00100000:1.0:1783135373.667943:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.667971:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809055104:0@lo:400: 00000100:00100000:1.0:1783135373.667991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.668011:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135373.668015:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809054976:0@lo:400: 00000100:00100000:1.0:1783135373.668035:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.668065:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809054976 00000100:00100000:1.0:1783135373.668071:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809054976 00000100:00100000:2.0:1783135373.668072:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809054464:0@lo:8: 00000100:00100000:2.0:1783135373.668129:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.668174:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809054720:0@lo:400: 00000100:00100000:2.0:1783135373.668209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.668229:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809055232:0@lo:400: 00000100:00100000:2.0:1783135373.668264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.668283:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135373.668289:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809054848:0@lo:400: 00000100:00100000:2.0:1783135373.668319:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.668360:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809054592 00000100:00100000:2.0:1783135373.668364:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809054592 00000100:00100000:2.0:1783135373.668391:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809055104 00000100:00100000:2.0:1783135373.668394:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809055104 00000100:00100000:2.0:1783135373.668426:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809055232 00000100:00100000:2.0:1783135373.668428:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809055232 00000100:00100000:2.0:1783135373.668440:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809054848 00000100:00100000:2.0:1783135373.668442:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809054848 00000100:00100000:2.0:1783135373.668456:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135373.668463:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809054592:12345-0@lo:400: 00000100:00100000:2.0:1783135373.668515:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809054592:12345-0@lo:400: Request processed in 51us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.668522:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135373.668539:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135373.668544:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809055104:12345-0@lo:400: 00000100:00100000:2.0:1783135373.668589:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809055104:12345-0@lo:400: Request processed in 45us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.668595:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135373.668605:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135373.668610:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809055232:12345-0@lo:400: 00000100:00100000:3.0:1783135373.668653:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809054464 00000100:00100000:2.0:1783135373.668657:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809055232:12345-0@lo:400: Request processed in 47us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135373.668658:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809054464 00000100:00100000:2.0:1783135373.668664:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135373.668675:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135373.668675:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135373.668680:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809054848:12345-0@lo:400: 00000100:00100000:3.0:1783135373.668681:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869752809054464:12345-0@lo:8: 00000100:00100000:2.0:1783135373.668705:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809054848:12345-0@lo:400: Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.668710:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1783135373.668715:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 277 last 0 00000100:00100000:2.0:1783135373.668731:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809054720 00000100:00100000:2.0:1783135373.668733:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809054720 00000100:00100000:2.0:1783135373.668747:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135373.668753:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809054720:12345-0@lo:400: 00000100:00100000:2.0:1783135373.668791:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809054720:12345-0@lo:400: Request processed in 38us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.668797:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1783135373.668839:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434f7100 x1869752809054848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135373.668851:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809054848:0@lo:400: 00000100:00100000:2.0:1783135373.668861:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809054720:0@lo:400: 00010000:00080000:2.0:1783135373.668869:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67c60fb80 x1869752809055232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135373.668877:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809055232:0@lo:400: 00010000:00080000:2.0:1783135373.668919:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434f6d80 x1869752809054592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135373.668927:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809054592:0@lo:400: 00010000:00080000:2.0:1783135373.668948:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67c60d880 x1869752809055104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135373.668956:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809055104:0@lo:400: 00000100:00080000:0.0:1783135373.669936:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135373.669940:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135373.669993:0:8602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.670024:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809055360 00000100:00100000:2.0:1783135373.670030:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809055360 00000100:00100000:0.0:1783135373.670032:0:8602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672e65600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135373.670061:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783135373.670068:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:8602:x1869752809055360:12345-0@lo:502: 00000100:00100000:2.0:1783135373.670210:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:8602:x1869752809055360:12345-0@lo:502: Request processed in 141us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.670217:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783135373.671919:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135373.671939:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809054976:12345-0@lo:400: 00000100:00100000:1.0:1783135373.672026:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809054976:12345-0@lo:400: Request processed in 96us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135373.672033:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135373.672107:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809054976:0@lo:400: 00000100:00100000:0.0:1783135373.672223:0:8602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8602:1869752809055360:0@lo:502: 00000020:01000000:0.0:1783135373.672257:0:8602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135373.672265:0:8602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135373.672268:0:8602:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783135373.672272:0:8602:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:00000080:3.0:1783135373.672547:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628edf7d2 00002000:00100000:3.0:1783135373.672602:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ac67c6f9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1783135373.672607:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1783135373.672611:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783135373.672683:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783135373.672882:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1783135373.672906:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6ff800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135373.672957:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869752809054464:12345-0@lo:8: Request processed in 4276us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135373.672966:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1783135373.673837:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1783135373.673862:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783135373.673872:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.673884:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135373.673895:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783135373.673897:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac64382e000 from 30 10000000:01000000:1.0:1783135373.673900:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135373.673931:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.673951:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.673961:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135373.673980:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809055488:0@lo:101: 00000100:00100000:1.0:1783135373.674020:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.674058:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.674315:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809055488 00000100:00100000:0.0:1783135373.674322:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809055488 00000100:00100000:0.0:1783135373.674356:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783135373.674364:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809055488:12345-0@lo:101: 00010000:00010000:0.0:1783135373.674375:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135373.674399:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65c800/0xf7de4ef628edf7e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf7d9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.674422:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65c800/0xf7de4ef628edf7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf7d9 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.674432:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65c800/0xf7de4ef628edf7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf7d9 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.674458:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c800, rc 0) 00000100:00100000:0.0:1783135373.674493:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809055488:12345-0@lo:101: Request processed in 129us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.674499:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783135373.674723:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809055488:0@lo:101: 00010000:00010000:1.0:1783135373.674747:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.674757:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135373.674812:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809055616:0@lo:501: 00000100:00100000:1.0:1783135373.674838:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.674867:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.675034:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809055616 00000100:00100000:0.0:1783135373.675038:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809055616 00000100:00100000:0.0:1783135373.675071:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783135373.675077:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809055616:12345-0@lo:501: 00000100:00100000:0.0:1783135373.675222:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809055616:12345-0@lo:501: Request processed in 144us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.675229:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783135373.675260:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809055616:0@lo:501: 00000100:00100000:0.0:1783135373.675287:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809055744:0@lo:503: 00000100:00100000:0.0:1783135373.675324:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135373.675338:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672e65cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.675361:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809055744 00000100:00100000:0.0:1783135373.675365:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809055744 00000100:00100000:0.0:1783135373.675386:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783135373.675392:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809055744:12345-0@lo:503: 00000100:00100000:0.0:1783135373.675478:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809055744:12345-0@lo:503: Request processed in 85us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.675489:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783135373.675525:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809055744:0@lo:503: 00000100:00100000:1.0:1783135373.678034:0:8606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8606:1869752809055872:0@lo:502: 00000100:00100000:1.0:1783135373.678145:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.678177:0:8606:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.678876:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809055872 00000100:00100000:0.0:1783135373.678885:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809055872 00000100:00100000:0.0:1783135373.678944:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783135373.678954:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:8606:x1869752809055872:12345-0@lo:502: 00000100:00100000:0.0:1783135373.679104:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:8606:x1869752809055872:12345-0@lo:502: Request processed in 135us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.679122:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783135373.679462:0:8606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8606:1869752809055872:0@lo:502: 00000100:00100000:1.0:1783135373.679522:0:8606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8606:1869752809056000:0@lo:502: 00000100:00100000:1.0:1783135373.680216:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.680256:0:8606:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6467c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.680323:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809056000 00000100:00100000:0.0:1783135373.680329:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809056000 00000100:00100000:0.0:1783135373.680613:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783135373.680622:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:8606:x1869752809056000:12345-0@lo:502: 00000100:00100000:0.0:1783135373.680721:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:8606:x1869752809056000:12345-0@lo:502: Request processed in 100us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.680727:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783135373.680837:0:8606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8606:1869752809056000:0@lo:502: 00000040:00080000:1.0:1783135373.680864:0:8606:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783135373.681109:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 00010000:00080000:3.0:1783135373.681278:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434f7480 x1869752809054464/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135373.681289:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135373.681297:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1783135373.681304:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783135373.681310:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783135373.681313:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac542771800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783135373.681325:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783135373.681331:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809054464:0@lo:8: 10000000:01000000:0.0:1783135373.681612:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783135373.681623:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.681634:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135373.681644:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783135373.681647:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac64382e000 from 5 10000000:01000000:0.0:1783135373.681650:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135373.681689:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.681698:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135373.681706:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135373.681723:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809056128:0@lo:101: 00000004:00080000:1.0:1783135373.682320:0:8603:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783135373.682402:0:8603:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 277475314041ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783135373.682410:0:8603:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1783135373.682598:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809056256:0@lo:41: 00000100:00100000:3.0:1783135373.682649:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135373.682691:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809056256 00000100:00100000:3.0:1783135373.682696:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809056256 00000100:00100000:3.0:1783135373.682734:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135373.682853:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135373.682882:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672e65000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.682919:0:8604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1869752809056384:0@lo:700: 00000100:00100000:0.0:1783135373.682952:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135373.682975:0:8604:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672e65780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135373.683062:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809056384 00000100:00100000:2.0:1783135373.683066:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809056384 00000100:00100000:2.0:1783135373.683131:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135373.683141:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8604:x1869752809056384:12345-0@lo:700: 00000100:00100000:0.0:1783135373.683141:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:0.0:1783135373.683148:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:2.0:1783135373.683177:0:8444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1869752809056512:0@lo:700: 00000100:00100000:2.0:1783135373.683221:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.683237:0:8444:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672de3000 going to sleep for 11 seconds 00000100:00080000:2.0:1783135373.683248:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135373.683263:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809056512 00000100:00100000:2.0:1783135373.683266:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809056512 00000100:00100000:2.0:1783135373.683289:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135373.683295:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1869752809056512:12345-0@lo:700: 00000100:00100000:1.0:1783135373.684221:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809056128 00000100:00100000:1.0:1783135373.684229:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809056128 00000100:00100000:1.0:1783135373.684263:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783135373.684270:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809056128:12345-0@lo:101: 00010000:00010000:1.0:1783135373.684281:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135373.684296:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf7ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf7e7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.684322:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf7ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf7e7 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.684333:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf7ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf7e7 expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.684341:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a600, rc 0) 00000100:00100000:1.0:1783135373.684391:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809056128:12345-0@lo:101: Request processed in 121us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135373.684398:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783135373.684446:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809056128:0@lo:101: 00010000:00010000:1.0:1783135373.684460:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.684470:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135373.684528:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809056640:0@lo:256: 00000100:00100000:1.0:1783135373.684578:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.684602:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6467c3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135373.684616:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809056640 00000100:00100000:1.0:1783135373.684620:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809056640 00000100:00100000:1.0:1783135373.684641:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783135373.684647:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809056640:12345-0@lo:256: 20000000:01000000:1.0:1783135373.684659:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135373.684676:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135373.684678:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1783135373.684749:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809056640:12345-0@lo:256: Request processed in 100us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135373.684756:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783135373.684783:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809056640:0@lo:256: 10000000:01000000:1.0:1783135373.684820:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135373.684827:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.684835:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135373.684843:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783135373.684845:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1783135373.684848:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783135373.684865:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.684883:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.684890:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135373.684902:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809056768:0@lo:101: 00000100:00100000:1.0:1783135373.684926:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.684940:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b1f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135373.684950:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809056768 00000100:00100000:1.0:1783135373.684953:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809056768 00000100:00100000:1.0:1783135373.684968:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783135373.684973:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809056768:12345-0@lo:101: 00010000:00010000:1.0:1783135373.684980:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135373.684987:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51b000/0xf7de4ef628edf7fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf7f5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.685000:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51b000/0xf7de4ef628edf7fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf7f5 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.685009:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51b000/0xf7de4ef628edf7fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf7f5 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.685015:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b000, rc 0) 00000100:00100000:1.0:1783135373.685041:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809056768:12345-0@lo:101: Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135373.685046:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783135373.685078:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809056768:0@lo:101: 00010000:00010000:1.0:1783135373.685127:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135373.685135:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135373.685181:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809056896:0@lo:501: 00000100:00100000:1.0:1783135373.685203:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.685216:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b1f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135373.685226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809056896 00000100:00100000:1.0:1783135373.685228:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809056896 00000100:00100000:1.0:1783135373.685245:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783135373.685250:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809056896:12345-0@lo:501: 00000100:00100000:1.0:1783135373.685347:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809056896:12345-0@lo:501: Request processed in 96us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135373.685353:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783135373.685377:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809056896:0@lo:501: 00000100:00100000:1.0:1783135373.685398:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809057024:0@lo:503: 00000100:00100000:1.0:1783135373.685429:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.685440:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b1f53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135373.685450:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809057024 00000100:00100000:1.0:1783135373.685453:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809057024 00000100:00100000:1.0:1783135373.685470:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783135373.685475:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809057024:12345-0@lo:503: 00000100:00100000:1.0:1783135373.685536:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809057024:12345-0@lo:503: Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135373.685542:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783135373.685594:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809057024:0@lo:503: 00000100:00100000:1.0:1783135373.685766:0:8609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8609:1869752809057152:0@lo:502: 00000100:00100000:1.0:1783135373.685793:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.685807:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809057152 00000100:00100000:1.0:1783135373.685810:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809057152 00000100:00100000:1.0:1783135373.685826:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783135373.685831:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:8609:x1869752809057152:12345-0@lo:502: 00000100:00100000:1.0:1783135373.685887:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:8609:x1869752809057152:12345-0@lo:502: Request processed in 55us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135373.685892:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783135373.685915:0:8609:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c6b5840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135373.685924:0:8609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8609:1869752809057152:0@lo:502: 00000020:01000000:1.0:1783135373.685946:0:8609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783135373.685952:0:8609:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1783135373.685958:0:8609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135373.685961:0:8609:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783135373.685966:0:8609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783135373.685969:0:8609:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:1.0:1783135373.685993:0:8609:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783135373.685995:0:8609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135373.686018:0:8609:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ac67e2d19c0) 00000020:00000080:1.0:1783135373.686041:0:8609:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1783135373.686048:0:8609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783135373.686147:0:8609:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783135373.686152:0:8609:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783135373.686158:0:8609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628edf80a 00010000:00080000:1.0:1783135373.686193:0:8609:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac67e2db800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1783135373.686409:0:8609:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1783135373.686610:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809056256:12345-0@lo:41: 00000004:00000024:3.0:1783135373.686640:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1783135373.686687:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809056256:12345-0@lo:41: Request processed in 85us (4037us total) trans 0 rc 0/0 00000004:00080000:2.0:1783135373.688792:0:7453:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1783135373.689207:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809056256:0@lo:41: 00000100:00100000:3.0:1783135373.695864:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 40000000:02000000:0.0:1783135373.708071:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:1.0:1783135373.712838:0:8609:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1783135373.712868:0:8609:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783135373.713172:0:8609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135373.715647:0:8609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135373.716771:0:8609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1783135373.716902:0:8609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783135373.727146:0:8611:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135373.727156:0:8611:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1783135373.728424:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1869752809056512:12345-0@lo:700: Request processed in 45120us (45193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.728440:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783135373.728503:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d90380 x1869752809056512/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783135389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135373.728521:0:8444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1869752809056512:0@lo:700: 40000000:02000000:0.0:1783135373.728533:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000020:00000080:3.0:1783135373.733900:0:8609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135373.733917:0:8609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783135373.733972:0:8609:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783135373.734002:0:8609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628edf811 00000100:00080000:3.0:1783135373.734013:0:8609:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135373.734019:0:8609:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ac67e2db800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135373.734058:0:8609:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac66b59bb80 x1869752809057280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135373.734083:0:8609:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783135373.734175:0:8609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135373.734180:0:8609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135373.734182:0:8609:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783135373.734185:0:8609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135373.734189:0:8609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135373.734191:0:8609:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783135373.734194:0:8609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783135373.734196:0:8609:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783135373.734226:0:8609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8609:1869752809057408:0@lo:502: 00000100:00100000:3.0:1783135373.734409:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135373.734525:0:8609:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5424c4780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135373.734546:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809057280:0@lo:8: 00000100:00100000:3.0:1783135373.734586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135373.734631:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809057408 00000100:00100000:3.0:1783135373.734637:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809057408 00000100:00100000:3.0:1783135373.734757:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783135373.734768:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:8609:x1869752809057408:12345-0@lo:502: 00000100:00100000:2.0:1783135373.734834:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809057280 00000100:00100000:2.0:1783135373.734840:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809057280 00000100:00100000:2.0:1783135373.734880:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135373.734886:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3645:x1869752809057280:12345-0@lo:8: 00000100:00100000:3.0:1783135373.734903:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:8609:x1869752809057408:12345-0@lo:502: Request processed in 137us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135373.734913:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:2.0:1783135373.734914:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1783135373.734947:0:8438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628edf818 00002000:00100000:2.0:1783135373.734962:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ac542777000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783135373.734967:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783135373.734970:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1783135373.734976:0:8609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:8609:1869752809057408:0@lo:502: 00000020:01000000:3.0:1783135373.735003:0:8609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135373.735009:0:8609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135373.735011:0:8609:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783135373.735014:0:8609:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:2.0:1783135373.735054:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783135373.735079:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8ac542777800 : changing import state from RECOVER to FULL 00000020:01000000:3.0:1783135373.735153:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:2.0:1783135373.735154:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869752809057280:12345-0@lo:8: Request processed in 266us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.735163:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:3.0:1783135373.735175:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783135373.735186:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135373.735196:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135373.735206:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00010000:00080000:2.0:1783135373.735206:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac66b59bb80 x1869752809057280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783135373.735211:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ac66b5899c0 from 1 10000000:01000000:3.0:1783135373.735217:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:2.0:1783135373.735221:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135373.735230:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783135373.735238:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783135373.735243:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783135373.735246:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67e2db800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00010000:3.0:1783135373.735256:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783135373.735259:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783135373.735266:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809057280:0@lo:8: 00010000:00010000:3.0:1783135373.735268:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135373.735280:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135373.735304:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809057536:0@lo:101: 00000100:00100000:3.0:1783135373.735333:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135373.735355:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5424c4780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135373.735370:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809057536 00000100:00100000:3.0:1783135373.735374:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809057536 00000100:00100000:3.0:1783135373.735407:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783135373.735415:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac641681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809057536:12345-0@lo:101: 00010000:00010000:3.0:1783135373.735423:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135373.735832:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edf826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf81f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135373.735859:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edf826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf81f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135373.735869:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edf826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf81f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135373.735879:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527600, rc 0) 00000100:00100000:3.0:1783135373.735913:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac641681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809057536:12345-0@lo:101: Request processed in 500us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135373.735919:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783135373.735958:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809057536:0@lo:101: 00010000:00010000:3.0:1783135373.735970:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135373.735979:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135373.736046:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809057664:0@lo:501: 00000004:00080000:1.0:1783135373.736057:0:8611:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1783135373.736074:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135373.736113:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5424c4780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135373.736128:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809057664 00000100:00100000:3.0:1783135373.736132:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809057664 00000004:00080000:1.0:1783135373.736144:0:8611:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 277529055335ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783135373.736153:0:8611:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783135373.736164:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783135373.736172:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809057664:12345-0@lo:501: 00000100:00100000:3.0:1783135373.736299:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809057664:12345-0@lo:501: Request processed in 126us (223us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783135373.736305:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783135373.736338:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809057664:0@lo:501: 10000000:01000000:3.0:1783135373.736360:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783135373.736641:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135373.736650:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1783135373.737242:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783135373.737252:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1783135373.737326:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8604:x1869752809056384:12345-0@lo:700: Request processed in 54185us (54370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.737345:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783135373.737383:0:8604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67c60e680 x1869752809056384/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783135389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135373.737394:0:8604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1869752809056384:0@lo:700: 00000004:00080000:3.0:1783135373.741008:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1783135373.748529:0:8613:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783135373.748568:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809057792:0@lo:13: 00000100:00100000:1.0:1783135373.748569:0:8613:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8613:1869752809057920:0@lo:7: 00000100:00100000:1.0:1783135373.759012:0:8613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.759350:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.759424:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809057792 00000100:00100000:0.0:1783135373.759490:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809057920 00000100:00100000:0.0:1783135373.759498:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809057920 00000100:00100000:0.0:1783135373.759572:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135373.759582:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8613:x1869752809057920:12345-0@lo:7: 00000100:00100000:2.0:1783135373.760424:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809057792 00000100:00100000:2.0:1783135373.760565:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135373.760573:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869752809057792:12345-0@lo:13: 00002000:00000024:2.0:1783135373.760604:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:2.0:1783135373.760679:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869752809057792:12345-0@lo:13: Request processed in 106us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.760686:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783135373.760739:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d99c00 x1869752809057792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135373.760758:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809057792:0@lo:13: 00000100:00100000:1.0:1783135373.761215:0:8613:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c6b50c0 going to sleep for 11 seconds 00000100:00080000:3.0:1783135373.764385:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783135373.766263:0:8604:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783135373.766304:0:8604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1869752809058176:0@lo:7: 00000100:00100000:1.0:1783135373.766519:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.766572:0:8604:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c6b59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135373.766671:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783135373.766678:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1783135373.767261:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135373.767280:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809058048:0@lo:13: 00000100:00100000:3.0:1783135373.767321:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135373.767463:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809058048 00000100:00100000:3.0:1783135373.767470:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809058048 00000100:00100000:1.0:1783135373.767510:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809058176 00000100:00100000:1.0:1783135373.767516:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809058176 00000100:00100000:3.0:1783135373.767528:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135373.767545:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809058048:12345-0@lo:13: 00002000:00000024:3.0:1783135373.767678:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:1.0:1783135373.767728:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135373.767730:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809058048:12345-0@lo:13: Request processed in 185us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135373.767738:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783135373.767784:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d99500 x1869752809058048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135373.767802:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809058048:0@lo:13: 00000100:00100000:1.0:1783135373.767813:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8604:x1869752809058176:12345-0@lo:7: 00002000:00080000:2.0:1783135373.773192:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783135373.773202:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783135373.773306:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8613:x1869752809057920:12345-0@lo:7: Request processed in 13721us (14295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.773318:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783135373.773390:0:8613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d9bb80 x1869752809057920/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783135389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135373.773407:0:8613:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8613:1869752809057920:0@lo:7: 00000004:00080000:2.0:1783135373.773422:0:8613:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783135373.773475:0:8613:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d91880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8613:1869752809058304:0@lo:5: 00000100:00100000:2.0:1783135373.773509:0:8613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135373.773533:0:8613:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672de36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135373.773564:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809058304 00000100:00100000:2.0:1783135373.773570:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809058304 00000100:00100000:2.0:1783135373.773610:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135373.773618:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8613:x1869752809058304:12345-0@lo:5: 00002000:00080000:2.0:1783135373.773647:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783135373.773651:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:0.0:1783135373.780298:0:8620:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783135373.780307:0:8620:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783135373.780414:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8604:x1869752809058176:12345-0@lo:7: Request processed in 12672us (13891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135373.780426:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783135373.780622:0:8604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d9b800 x1869752809058176/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783135389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135373.780640:0:8604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1869752809058176:0@lo:7: 00000004:00080000:1.0:1783135373.780664:0:8604:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1783135373.780704:0:8604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1869752809058432:0@lo:5: 00000100:00100000:1.0:1783135373.780755:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.780788:0:8604:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c6b59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135373.780999:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8613:x1869752809058304:12345-0@lo:5: Request processed in 7379us (7487us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783135373.781016:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135373.782346:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809058432 00000100:00100000:2.0:1783135373.782360:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809058432 00000100:00100000:2.0:1783135373.782472:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135373.782494:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8604:x1869752809058432:12345-0@lo:5: 00002000:00080000:2.0:1783135373.782523:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1783135373.782599:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8604:x1869752809058432:12345-0@lo:5: Request processed in 119us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.782607:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783135373.782668:0:8604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d9b800 x1869752809058432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135373.782684:0:8604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1869752809058432:0@lo:5: 00000004:00080000:3.0:1783135373.782696:0:8604:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1783135373.782733:0:8604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1869752809058560:0@lo:5: 00000100:00100000:3.0:1783135373.782778:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783135373.782798:0:8613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d91880 x1869752809058304/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135389 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135373.782811:0:8613:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d91880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8613:1869752809058304:0@lo:5: 00000004:00080000:1.0:1783135373.782820:0:8613:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1783135373.782842:0:8613:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8613:1869752809058688:0@lo:700: 00000100:00100000:1.0:1783135373.782869:0:8613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135373.782907:0:8613:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c6b5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135373.783369:0:8604:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5424c4780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135373.783420:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809058560 00000100:00100000:0.0:1783135373.783434:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809058560 00000100:00100000:0.0:1783135373.783624:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135373.783636:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8604:x1869752809058560:12345-0@lo:5: 00002000:00080000:0.0:1783135373.783671:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1783135373.785949:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8604:x1869752809058560:12345-0@lo:5: Request processed in 2311us (3166us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783135373.786209:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783135373.786262:0:8604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac66b59bb80 x1869752809058560/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135373.786282:0:8604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1869752809058560:0@lo:5: 00000004:00080000:0.0:1783135373.786297:0:8604:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1783135373.786342:0:8604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8604:1869752809058816:0@lo:900: 00000100:00100000:0.0:1783135373.786388:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135373.786410:0:8604:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493626c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135373.786637:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809058688 00000100:00100000:3.0:1783135373.786644:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809058688 00000100:00100000:3.0:1783135373.786692:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135373.786703:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8613:x1869752809058688:12345-0@lo:700: 00000100:00100000:2.0:1783135373.788690:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809058816 00000100:00100000:2.0:1783135373.788701:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809058816 00000100:00100000:2.0:1783135373.788756:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135373.788766:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8604:x1869752809058816:12345-0@lo:900: 00000100:00100000:2.0:1783135373.788861:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8604:x1869752809058816:12345-0@lo:900: Request processed in 95us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135373.788870:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783135373.788890:0:8604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67c60e680 x1869752809058816/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783135389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135373.788906:0:8604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8604:1869752809058816:0@lo:900: 00000001:00080000:2.0:1783135373.791838:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1783135373.791856:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1783135373.792912:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8613:x1869752809058688:12345-0@lo:700: Request processed in 6206us (10035us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135373.792926:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783135373.793003:0:8613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d9a300 x1869752809058688/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783135389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135373.793015:0:8613:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783135373.793031:0:8613:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8613:1869752809058688:0@lo:700: 00000004:02000040:2.0:1783135373.796158:0:8613:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1783135373.802541:0:8613:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8613:1869752809058944:0@lo:5: 00000100:00100000:0.0:1783135373.802737:0:8613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135373.802845:0:8613:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493626c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135373.806252:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809058944 00000100:00100000:3.0:1783135373.806272:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809058944 00000100:00100000:3.0:1783135373.806360:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135373.806372:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8613:x1869752809058944:12345-0@lo:5: 00002000:00080000:3.0:1783135373.819893:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1783135373.819913:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1783135373.828622:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8613:x1869752809058944:12345-0@lo:5: Request processed in 22247us (25881us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783135373.828639:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783135373.828688:0:8613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67c60f800 x1869752809058944/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135389 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135373.828707:0:8613:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8613:1869752809058944:0@lo:5: 00000004:00080000:1.0:1783135373.828721:0:8613:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1783135374.197251:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135375.225141:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135376.238683:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135376.754342:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135376.754376:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809059072:0@lo:41: 00000100:00100000:2.0:1783135376.754475:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135376.754737:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809059072 00000100:00100000:2.0:1783135376.754747:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809059072 00000100:00100000:2.0:1783135376.754813:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783135376.754822:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809059072:12345-0@lo:41: 00000004:00000024:2.0:1783135376.754874:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1783135376.754922:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809059072:12345-0@lo:41: Request processed in 101us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135376.754928:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783135376.754972:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809059072:0@lo:41: 00010000:00010000:3.0:1783135377.268175:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135378.076335:0:8817:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783135378.286990:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135378.798246:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135378.798271:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809059200:0@lo:13: 00000100:00100000:3.0:1783135378.798367:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135378.798436:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809059200 00000100:00100000:3.0:1783135378.798443:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809059200 00000100:00100000:3.0:1783135378.798510:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135378.798541:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809059200:12345-0@lo:13: 00002000:00000024:3.0:1783135378.798578:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135378.798626:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809059200:12345-0@lo:13: Request processed in 108us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135378.798633:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783135378.798655:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135378.798689:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac542799c00 x1869752809059200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135378.798701:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783135378.798740:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809059200:0@lo:13: 00000100:00100000:3.0:1783135378.800795:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809059456:0@lo:41: 00000100:00100000:3.0:1783135378.800861:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135378.801034:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135378.801041:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809059328:0@lo:13: 00000100:00100000:3.0:1783135378.801076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135378.801145:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809059456 00000100:00100000:3.0:1783135378.801152:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809059456 00000100:00100000:3.0:1783135378.801203:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135378.801212:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809059456:12345-0@lo:41: 00000004:00000024:3.0:1783135378.801248:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1783135378.801990:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809059456:12345-0@lo:41: Request processed in 774us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135378.802001:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135378.802046:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809059328 00000100:00100000:3.0:1783135378.802052:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809059328 00000100:00100000:3.0:1783135378.802124:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135378.802133:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869752809059328:12345-0@lo:13: 00002000:00000024:3.0:1783135378.802152:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135378.802192:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869752809059328:12345-0@lo:13: Request processed in 60us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135378.802198:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1783135378.802218:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783135378.802471:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac542799c00 x1869752809059328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135378.802795:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809059328:0@lo:13: 00000100:00100000:2.0:1783135378.802820:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809059456:0@lo:41: 00000100:00100000:3.0:1783135378.804122:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809059584:0@lo:400: 00000100:00100000:3.0:1783135378.804187:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135378.804241:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135378.804248:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809059712:0@lo:400: 00000100:00100000:2.0:1783135378.804785:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809059840:0@lo:400: 00000100:00100000:2.0:1783135378.804826:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809060224:0@lo:400: 00000100:00100000:2.0:1783135378.804853:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809059968:0@lo:400: 00000100:00100000:0.0:1783135378.804983:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809059584 00000100:00100000:0.0:1783135378.804991:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809059584 00000100:00100000:0.0:1783135378.805046:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783135378.805055:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3648:x1869752809059584:12345-0@lo:400: 00000100:00100000:0.0:1783135378.805123:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3648:x1869752809059584:12345-0@lo:400: Request processed in 68us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135378.805130:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783135378.805447:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135378.805810:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809059968 00000100:00100000:0.0:1783135378.805816:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809059968 00000100:00100000:0.0:1783135378.805853:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783135378.805860:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809059968:12345-0@lo:400: 00000100:00100000:3.0:1783135378.806465:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135378.806768:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809059968:12345-0@lo:400: Request processed in 906us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135378.806776:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783135378.812609:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809059968:0@lo:400: 00000100:00100000:2.0:1783135378.813414:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809059712 00000100:00100000:2.0:1783135378.813425:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809059712 00000100:00100000:2.0:1783135378.814129:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135378.814143:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809059712:12345-0@lo:400: 00000100:00100000:2.0:1783135378.814239:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809059712:12345-0@lo:400: Request processed in 100us (7784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135378.814246:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135378.814725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783135378.815294:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d92680 x1869752809059712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135378.815311:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809059712:0@lo:400: 00000100:00100000:1.0:1783135378.815325:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809059584:0@lo:400: 00000100:00100000:1.0:1783135378.815379:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809060096:0@lo:400: 00000100:00100000:1.0:1783135378.815423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135378.815854:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809059840 00000100:00100000:0.0:1783135378.815863:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809059840 00000100:00100000:0.0:1783135378.815926:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135378.815935:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809059840:12345-0@lo:400: 00000100:00100000:0.0:1783135378.815992:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809059840:12345-0@lo:400: Request processed in 58us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135378.815998:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1783135378.816166:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d90000 x1869752809059840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135378.816177:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809059840:0@lo:400: 00000100:00100000:1.0:1783135378.817846:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809060096 00000100:00100000:1.0:1783135378.817858:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809060096 00000100:00100000:1.0:1783135378.817934:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135378.817943:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809060096:12345-0@lo:400: 00000100:00100000:1.0:1783135378.818016:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809060096:12345-0@lo:400: Request processed in 73us (2592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135378.818023:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1783135378.818047:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783135378.818071:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d90380 x1869752809060096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135378.818084:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809060096:0@lo:400: 00000100:00100000:2.0:1783135378.820067:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135378.821482:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809060224 00000100:00100000:1.0:1783135378.821649:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809060224 00000100:00080000:2.0:1783135378.821802:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135378.821856:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135378.821950:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809060224:12345-0@lo:400: 00000100:00100000:1.0:1783135378.823484:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809060224:12345-0@lo:400: Request processed in 1611us (3985us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135378.823506:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783135378.827985:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d91180 x1869752809060224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135378.828005:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809060224:0@lo:400: 00000020:00000004:3.0:1783135379.146286:0:8869:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135379.148807:0:8869:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783135379.310271:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783135379.318231:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1783135380.334413:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135381.360060:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135381.875278:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809060352:0@lo:41: 00000100:00100000:0.0:1783135381.875381:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135381.875506:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809060352 00000100:00100000:0.0:1783135381.875515:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809060352 00000100:00100000:0.0:1783135381.875576:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783135381.875589:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809060352:12345-0@lo:41: 00000004:00000024:0.0:1783135381.875636:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1783135381.875697:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809060352:12345-0@lo:41: Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135381.875705:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783135381.875765:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809060352:0@lo:41: 00010000:00010000:2.0:1783135382.383291:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783135382.828334:0:8970:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783135382.828652:0:8970:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783135383.409246:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135383.918532:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809060480:0@lo:400: 00000100:00100000:3.0:1783135383.918657:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.918732:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809060992:0@lo:400: 00000100:00100000:3.0:1783135383.918766:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.918806:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809061504:0@lo:400: 00000100:00100000:3.0:1783135383.918836:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.918866:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783135383.918872:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809060864:0@lo:400: 00000100:00100000:3.0:1783135383.918899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.918919:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809061376:0@lo:400: 00000100:00100000:3.0:1783135383.918941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.918975:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809060608:0@lo:400: 00000100:00100000:3.0:1783135383.919017:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.919039:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809061120:0@lo:400: 00000100:00100000:3.0:1783135383.919069:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.919114:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809061632:0@lo:13: 00000100:00100000:3.0:1783135383.919140:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.919160:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783135383.919166:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809060736:0@lo:400: 00000100:00100000:3.0:1783135383.919187:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.919203:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809061248:0@lo:400: 00000100:00100000:3.0:1783135383.919228:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.919264:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809060480 00000100:00100000:3.0:1783135383.919273:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809060480 00000100:00100000:3.0:1783135383.919340:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783135383.919351:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3647:x1869752809060480:12345-0@lo:400: 00000100:00100000:3.0:1783135383.919439:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3647:x1869752809060480:12345-0@lo:400: Request processed in 89us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.919447:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783135383.919494:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809060992 00000100:00100000:3.0:1783135383.919498:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809060992 00000100:00100000:3.0:1783135383.919521:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809060736 00000100:00100000:3.0:1783135383.919524:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809060736 00000100:00100000:3.0:1783135383.919541:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135383.919548:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809060992:12345-0@lo:400: 00000100:00100000:3.0:1783135383.919588:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809060992:12345-0@lo:400: Request processed in 40us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.919594:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135383.919608:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135383.919615:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809060736:12345-0@lo:400: 00000100:00100000:3.0:1783135383.919647:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809060736:12345-0@lo:400: Request processed in 33us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.919653:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135383.919675:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809061504 00000100:00100000:3.0:1783135383.919680:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809061504 00000100:00100000:3.0:1783135383.919719:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809061376 00000100:00100000:3.0:1783135383.919723:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809061376 00000100:00100000:3.0:1783135383.919749:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135383.919757:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809061504:12345-0@lo:400: 00000100:00100000:3.0:1783135383.919791:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809061504:12345-0@lo:400: Request processed in 36us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.919797:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135383.919808:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135383.919815:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809061376:12345-0@lo:400: 00000100:00100000:3.0:1783135383.919854:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809061376:12345-0@lo:400: Request processed in 40us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.919860:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135383.919883:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809060864 00000100:00100000:3.0:1783135383.919886:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809060864 00000100:00100000:3.0:1783135383.919907:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809060608 00000100:00100000:3.0:1783135383.919911:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809060608 00000100:00100000:3.0:1783135383.919920:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809061120 00000100:00100000:3.0:1783135383.919923:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809061120 00000100:00100000:3.0:1783135383.919936:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809061248 00000100:00100000:3.0:1783135383.919939:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809061248 00000100:00100000:3.0:1783135383.919953:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135383.919959:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809060864:12345-0@lo:400: 00000100:00100000:3.0:1783135383.919994:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809060864:12345-0@lo:400: Request processed in 35us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.920000:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135383.920015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135383.920021:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809060608:12345-0@lo:400: 00000100:00100000:3.0:1783135383.920049:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809060608:12345-0@lo:400: Request processed in 29us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.920054:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135383.920063:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135383.920070:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809061120:12345-0@lo:400: 00000100:00100000:3.0:1783135383.920124:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809061120:12345-0@lo:400: Request processed in 55us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.920131:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135383.920142:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135383.920149:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809061248:12345-0@lo:400: 00000100:00100000:3.0:1783135383.920186:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809061248:12345-0@lo:400: Request processed in 37us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.920191:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135383.920225:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809061632 00000100:00100000:3.0:1783135383.920229:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809061632 00000100:00100000:3.0:1783135383.920257:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135383.920264:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809061632:12345-0@lo:13: 00002000:00000024:3.0:1783135383.920290:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135383.920320:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809061632:12345-0@lo:13: Request processed in 58us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.920326:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783135383.920354:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135383.920370:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135383.920373:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135383.920423:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809060736:0@lo:400: 00010000:00080000:3.0:1783135383.920439:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac542799500 x1869752809061248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135383.920450:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809061248:0@lo:400: 00010000:00080000:3.0:1783135383.920460:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac542798700 x1869752809060608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135383.920469:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809060608:0@lo:400: 00010000:00080000:3.0:1783135383.920480:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac54279aa00 x1869752809061120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135383.920488:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809061120:0@lo:400: 00010000:00080000:3.0:1783135383.920498:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac542799f80 x1869752809061632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135383.920519:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809061632:0@lo:13: 00010000:00080000:3.0:1783135383.920563:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac542799180 x1869752809060864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135383.920572:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809060864:0@lo:400: 00010000:00080000:3.0:1783135383.920580:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac542798380 x1869752809061376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135383.920587:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809061376:0@lo:400: 00000100:00100000:3.0:1783135383.920596:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809060480:0@lo:400: 00000100:00100000:3.0:1783135383.920606:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809060992:0@lo:400: 00010000:00080000:3.0:1783135383.920616:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac54279ad80 x1869752809061504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135383.920624:0:3647:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1783135383.920651:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809061504:0@lo:400: 00000100:00100000:3.0:1783135383.928969:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809061760:0@lo:13: 00000100:00100000:3.0:1783135383.929073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135383.929165:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809061760 00000100:00100000:3.0:1783135383.929174:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809061760 00000100:00100000:3.0:1783135383.929241:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135383.929252:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809061760:12345-0@lo:13: 00002000:00000024:3.0:1783135383.929284:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135383.929336:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809061760:12345-0@lo:13: Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135383.929357:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783135383.931222:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434e2d80 x1869752809061760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135383.931266:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809061760:0@lo:13: 00000100:00100000:1.0:1783135383.938276:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135383.938310:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809061888:0@lo:41: 00000100:00100000:1.0:1783135383.938424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135383.938482:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809061888 00000100:00100000:1.0:1783135383.938492:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809061888 00000100:00100000:1.0:1783135383.938550:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135383.938561:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809061888:12345-0@lo:41: 00000004:00000024:1.0:1783135383.938619:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1783135383.938689:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809061888:12345-0@lo:41: Request processed in 128us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135383.938697:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135383.938759:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809061888:0@lo:41: 00000020:00000004:3.0:1783135384.092540:0:9018:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135384.092555:0:9018:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1783135384.431007:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135385.462580:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135386.478385:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135386.991293:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135386.991353:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809062016:0@lo:41: 00000100:00100000:2.0:1783135386.991469:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135386.993567:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809062016 00000100:00100000:0.0:1783135386.993589:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809062016 00000100:00100000:0.0:1783135386.993678:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783135386.993692:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809062016:12345-0@lo:41: 00000004:00000024:0.0:1783135386.993745:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1783135386.993869:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809062016:12345-0@lo:41: Request processed in 179us (2400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135386.993877:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783135386.993950:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809062016:0@lo:41: 00010000:00010000:2.0:1783135387.507793:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135388.526306:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135389.040986:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809062144:0@lo:13: 00000100:00100000:3.0:1783135389.041113:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135389.041214:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809062144 00000100:00100000:3.0:1783135389.041223:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809062144 00000100:00100000:3.0:1783135389.041309:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135389.041332:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809062144:12345-0@lo:13: 00002000:00000024:3.0:1783135389.041373:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135389.041428:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809062144:12345-0@lo:13: Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135389.041435:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1783135389.041463:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135389.041503:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434e2d80 x1869752809062144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135389.041523:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809062144:0@lo:13: 00000100:00100000:1.0:1783135389.042076:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809062400:0@lo:400: 00000100:00100000:1.0:1783135389.042151:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135389.042177:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809062912:0@lo:400: 00000100:00100000:1.0:1783135389.042199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135389.042227:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135389.042232:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809062528:0@lo:400: 00000100:00100000:1.0:1783135389.042258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135389.042290:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809063040:0@lo:400: 00000100:00100000:1.0:1783135389.042340:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135389.042384:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809062400 00000100:00100000:1.0:1783135389.042392:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809062400 00000100:00100000:1.0:1783135389.042434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809062912 00000100:00100000:1.0:1783135389.042437:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809062912 00000100:00100000:1.0:1783135389.042468:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809063040 00000100:00100000:1.0:1783135389.042471:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809063040 00000100:00100000:1.0:1783135389.042489:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135389.042497:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809062400:12345-0@lo:400: 00000100:00100000:1.0:1783135389.042552:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809062400:12345-0@lo:400: Request processed in 56us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135389.042558:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135389.042575:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135389.042588:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809062912:12345-0@lo:400: 00000100:00100000:1.0:1783135389.042617:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809062912:12345-0@lo:400: Request processed in 30us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135389.042622:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135389.042635:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783135389.042640:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809063040:12345-0@lo:400: 00000100:00100000:1.0:1783135389.042665:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809063040:12345-0@lo:400: Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135389.042670:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783135389.042695:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809062528 00000100:00100000:1.0:1783135389.042699:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809062528 00000100:00100000:1.0:1783135389.042726:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783135389.042732:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809062528:12345-0@lo:400: 00000100:00100000:1.0:1783135389.042778:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809062528:12345-0@lo:400: Request processed in 46us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135389.042785:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783135389.042819:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809062272:0@lo:400: 00000100:00100000:1.0:1783135389.042855:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135389.042876:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809062784:0@lo:400: 00000100:00100000:1.0:1783135389.042897:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135389.042913:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783135389.042918:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809062656:0@lo:400: 00000100:00100000:1.0:1783135389.042936:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135389.042951:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809063168:0@lo:400: 00000100:00100000:1.0:1783135389.042975:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135389.043008:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809063168 00000100:00100000:1.0:1783135389.043019:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809063168 00000100:00100000:1.0:1783135389.043056:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135389.043063:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809063168:12345-0@lo:400: 00000100:00100000:1.0:1783135389.043125:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809063168:12345-0@lo:400: Request processed in 63us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135389.043131:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1783135389.043366:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135389.043372:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135389.043382:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135389.043417:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809062528:0@lo:400: 00010000:00080000:0.0:1783135389.043440:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67b191500 x1869752809063040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135389.043452:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809063040:0@lo:400: 00010000:00080000:0.0:1783135389.043463:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d9b800 x1869752809062400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135389.043472:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809062400:0@lo:400: 00010000:00080000:0.0:1783135389.043483:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67b192680 x1869752809062912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135389.043492:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809062912:0@lo:400: 00000100:00100000:0.0:1783135389.043521:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135389.043529:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809063296:0@lo:13: 00000100:00100000:0.0:1783135389.043563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135389.043600:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809063296 00000100:00100000:0.0:1783135389.043604:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809063296 00000100:00100000:0.0:1783135389.043634:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135389.043640:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809063296:12345-0@lo:13: 00002000:00000024:0.0:1783135389.043659:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135389.043695:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809063296:12345-0@lo:13: Request processed in 55us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135389.043702:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783135389.043730:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67c60c700 x1869752809063296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135389.043743:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809063296:0@lo:13: 00000100:00100000:0.0:1783135389.043776:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809062784 00000100:00100000:0.0:1783135389.043779:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809062784 00000100:00100000:0.0:1783135389.043799:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783135389.043806:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809062784:12345-0@lo:400: 00000100:00100000:0.0:1783135389.043835:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809062784:12345-0@lo:400: Request processed in 30us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135389.043842:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783135389.043858:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809062656 00000100:00100000:0.0:1783135389.043861:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809062656 00000100:00100000:0.0:1783135389.043884:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135389.043890:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809062656:12345-0@lo:400: 00000100:00100000:0.0:1783135389.043915:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809062656:12345-0@lo:400: Request processed in 26us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135389.043921:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783135389.043953:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d99500 x1869752809062656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135389.043963:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809062656:0@lo:400: 00010000:00080000:0.0:1783135389.043972:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67b191180 x1869752809063168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135389.043979:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809063168:0@lo:400: 00000100:00100000:0.0:1783135389.043989:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809062784:0@lo:400: 00000100:00100000:3.0:1783135389.044385:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809062272 00000100:00100000:3.0:1783135389.044391:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809062272 00000100:00100000:3.0:1783135389.044436:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783135389.044445:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3649:x1869752809062272:12345-0@lo:400: 00000100:00100000:3.0:1783135389.044493:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3649:x1869752809062272:12345-0@lo:400: Request processed in 52us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135389.044509:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783135389.044564:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135389.044577:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809063424:0@lo:41: 00000100:00100000:3.0:1783135389.044608:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135389.044639:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809063424 00000100:00100000:3.0:1783135389.044642:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809063424 00000100:00100000:3.0:1783135389.044668:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783135389.044845:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809063424:12345-0@lo:41: 00000004:00000024:3.0:1783135389.044879:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1783135389.044916:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809063424:12345-0@lo:41: Request processed in 242us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135389.044922:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783135389.044969:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809063424:0@lo:41: 00000100:00100000:0.0:1783135389.045077:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809062272:0@lo:400: 00010000:00010000:0.0:1783135389.552465:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135390.574293:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135391.609014:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135392.112968:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809063552:0@lo:41: 00000100:00100000:3.0:1783135392.113067:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135392.113261:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809063552 00000100:00100000:0.0:1783135392.113271:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809063552 00000100:00100000:0.0:1783135392.113349:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783135392.113359:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809063552:12345-0@lo:41: 00000004:00000024:0.0:1783135392.113410:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1783135392.113465:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809063552:12345-0@lo:41: Request processed in 106us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135392.113472:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783135392.113771:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809063552:0@lo:41: 00010000:00010000:1.0:1783135392.646305:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135393.654290:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135394.163344:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809063936:0@lo:400: 00000100:00100000:2.0:1783135394.163422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135394.163469:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809064448:0@lo:400: 00000100:00100000:2.0:1783135394.163497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135394.163519:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809064960:0@lo:400: 00000100:00100000:2.0:1783135394.163542:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135394.163566:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783135394.163581:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809064064:0@lo:400: 00000100:00100000:2.0:1783135394.163606:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135394.163625:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809064576:0@lo:400: 00000100:00100000:2.0:1783135394.163644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135394.163676:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809063936 00000100:00100000:2.0:1783135394.163683:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809063936 00000100:00100000:2.0:1783135394.163726:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783135394.163735:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3646:x1869752809063936:12345-0@lo:400: 00000100:00100000:2.0:1783135394.163785:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3646:x1869752809063936:12345-0@lo:400: Request processed in 51us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135394.163792:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783135394.163827:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809064448 00000100:00100000:2.0:1783135394.163831:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809064448 00000100:00100000:2.0:1783135394.163858:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135394.163864:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809064448:12345-0@lo:400: 00000100:00100000:2.0:1783135394.163897:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809064448:12345-0@lo:400: Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135394.163903:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135394.163922:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809064960 00000100:00100000:2.0:1783135394.163925:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809064960 00000100:00100000:2.0:1783135394.163973:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135394.163979:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809064960:12345-0@lo:400: 00000100:00100000:2.0:1783135394.164007:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809064960:12345-0@lo:400: Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135394.164013:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135394.164029:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809064064 00000100:00100000:2.0:1783135394.164032:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809064064 00000100:00100000:2.0:1783135394.164062:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809064576 00000100:00100000:2.0:1783135394.164260:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809064576 00000100:00100000:2.0:1783135394.164293:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783135394.164299:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809064064:12345-0@lo:400: 00000100:00100000:2.0:1783135394.164333:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809064064:12345-0@lo:400: Request processed in 34us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135394.164339:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783135394.164350:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783135394.164355:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809064576:12345-0@lo:400: 00000100:00100000:2.0:1783135394.164383:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809064576:12345-0@lo:400: Request processed in 27us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135394.164388:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1783135394.164442:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d93100 x1869752809064064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135394.164457:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809064064:0@lo:400: 00010000:00080000:2.0:1783135394.164468:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d92680 x1869752809064576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135394.164476:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809064576:0@lo:400: 00000100:00100000:2.0:1783135394.164483:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809063936:0@lo:400: 00000100:00100000:2.0:1783135394.164492:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809064448:0@lo:400: 00010000:00080000:2.0:1783135394.164501:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434f4380 x1869752809064960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135394.164509:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809064960:0@lo:400: 00000100:00080000:0.0:1783135394.165207:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135394.165214:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135394.165232:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809063680:0@lo:41: 00000100:00100000:0.0:1783135394.165284:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135394.165319:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809064192:0@lo:400: 00000100:00100000:0.0:1783135394.165339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135394.165354:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809064704:0@lo:400: 00000100:00100000:0.0:1783135394.165397:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135394.165421:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783135394.165445:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809063808:0@lo:13: 00000100:00100000:0.0:1783135394.165469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135394.165489:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809064320:0@lo:400: 00000100:00100000:0.0:1783135394.165509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135394.165522:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809064832:0@lo:400: 00000100:00100000:0.0:1783135394.165544:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135394.165581:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809063808 00000100:00100000:0.0:1783135394.165587:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809063808 00000100:00100000:2.0:1783135394.165736:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809063680 00000100:00100000:2.0:1783135394.165747:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809063680 00000100:00100000:2.0:1783135394.165767:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809064192 00000100:00100000:2.0:1783135394.165770:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809064192 00000100:00100000:2.0:1783135394.165782:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135394.165789:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1869752809063680:12345-0@lo:41: 00000004:00000024:2.0:1783135394.165830:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1783135394.165898:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1869752809063680:12345-0@lo:41: Request processed in 109us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135394.165905:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135394.165919:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783135394.165924:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809064192:12345-0@lo:400: 00000100:00100000:2.0:1783135394.165952:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809064192:12345-0@lo:400: Request processed in 27us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135394.165958:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783135394.170277:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809064832 00000100:00100000:1.0:1783135394.170294:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809064832 00000100:00100000:1.0:1783135394.170379:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135394.170390:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809064832:12345-0@lo:400: 00000100:00100000:1.0:1783135394.170494:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809064832:12345-0@lo:400: Request processed in 106us (4948us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135394.170501:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135394.175941:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809065088:0@lo:13: 00000100:00100000:3.0:1783135394.176019:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135394.176141:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809064704 00000100:00100000:3.0:1783135394.176149:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809064704 00000100:00100000:3.0:1783135394.176215:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809064320 00000100:00100000:3.0:1783135394.176219:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809064320 00000100:00100000:3.0:1783135394.176254:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135394.176265:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809064704:12345-0@lo:400: 00000100:00100000:3.0:1783135394.176320:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809064704:12345-0@lo:400: Request processed in 56us (10921us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135394.176338:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135394.176357:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783135394.176365:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809064320:12345-0@lo:400: 00000100:00100000:3.0:1783135394.176394:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809064320:12345-0@lo:400: Request processed in 32us (10884us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135394.176399:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1783135394.178196:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d90000 x1869752809064320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135394.178217:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809064320:0@lo:400: 00010000:00080000:2.0:1783135394.178232:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434f6d80 x1869752809064832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135394.178241:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809064832:0@lo:400: 00000100:00100000:2.0:1783135394.178265:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809063680:0@lo:41: 00000100:00100000:2.0:1783135394.178274:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809064192:0@lo:400: 00010000:00080000:2.0:1783135394.178285:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434f7480 x1869752809064704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135394.178294:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809064704:0@lo:400: 00000100:00100000:1.0:1783135394.184563:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809065088 00000100:00100000:1.0:1783135394.184581:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809065088 00000100:00100000:1.0:1783135394.184645:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135394.184656:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809063808:12345-0@lo:13: 00002000:00000024:1.0:1783135394.184696:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135394.184802:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809063808:12345-0@lo:13: Request processed in 147us (19330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135394.184810:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135394.184844:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135394.184850:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809065088:12345-0@lo:13: 00002000:00000024:1.0:1783135394.184859:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135394.184884:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809065088:12345-0@lo:13: Request processed in 35us (8866us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135394.184889:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1783135394.185206:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d90700 x1869752809063808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135394.185227:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809063808:0@lo:13: 00010000:00080000:3.0:1783135394.185266:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434e2680 x1869752809065088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135394.185279:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809065088:0@lo:13: 00000100:00080000:0.0:1783135394.186733:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135394.186743:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783135394.670521:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135395.696898:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135396.718499:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135397.230494:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809065216:0@lo:41: 00000100:00100000:3.0:1783135397.230573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135397.232387:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809065216 00000100:00100000:2.0:1783135397.232400:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809065216 00000100:00100000:2.0:1783135397.232463:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135397.232473:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809065216:12345-0@lo:41: 00000004:00000024:2.0:1783135397.232512:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1783135397.233840:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809065216:12345-0@lo:41: Request processed in 1361us (3259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135397.233852:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783135397.238381:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809065216:0@lo:41: 00010000:00010000:0.0:1783135397.742333:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135397.810896:0:9518:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783135397.810900:0:9518:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1783135397.810902:0:9518:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1783135397.811040:0:9518:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ac67e2d9800 00000020:01000004:1.0:1783135397.811056:0:9518:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1783135397.811070:0:9518:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783135397.811084:0:9518:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ac67e2d4d40) 00000020:00000080:1.0:1783135397.811144:0:9518:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783135397.865259:0:9518:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783135397.865326:0:9518:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1783135397.918550:0:9518:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783135397.920056:0:9518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783135397.920077:0:9518:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135397.920124:0:9518:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7de4ef628edf834 00000020:01000004:3.0:1783135397.920316:0:9518:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783135397.920345:0:9518:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783135397.920349:0:9518:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783135397.920356:0:9518:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783135397.920393:0:9518:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1783135397.920409:0:9518:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783135397.997732:0:9518:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783135397.997777:0:9518:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.106@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1783135397.997781:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783135397.997783:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135397.997784:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135397.997786:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135397.997787:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135397.997788:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135397.997790:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135397.997791:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135397.997792:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135397.997794:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135397.997795:0:9518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135397.997798:0:9518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1783135397.997800:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135397.997801:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135397.997802:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135397.997804:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135397.997805:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135397.997806:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135397.997807:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135397.997808:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135397.997808:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135397.997809:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135397.997810:0:9518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135397.997835:0:9518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783135397.997854:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809065344:0@lo:253: 00000100:00100000:3.0:1783135397.997932:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135397.997984:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac64a189000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135397.998513:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809065344 00000100:00100000:0.0:1783135397.998522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809065344 00000100:00100000:0.0:1783135397.998581:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783135397.998590:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:9518:x1869752809065344:12345-0@lo:253: 20000000:01000000:0.0:1783135397.998640:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783135397.998645:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1783135397.998650:0:6516:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1783135397.998654:0:6516:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1783135397.998931:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135397.999463:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1783135397.999484:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1783135397.999504:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1783135397.999510:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1783135397.999523:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1783135397.999540:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1783135397.999638:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1783135397.999654:0:6516:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.106@tcp 20000000:01000000:0.0:1783135397.999656:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:0.0:1783135397.999671:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1783135397.999678:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783135397.999691:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1783135397.999697:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:0.0:1783135397.999709:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1783135397.999716:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783135397.999728:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1783135397.999840:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1783135397.999917:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1783135397.999927:0:6516:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.106@tcp 20000000:01000000:0.0:1783135397.999929:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:0.0:1783135397.999943:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1783135397.999950:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783135397.999972:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1783135397.999978:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:0.0:1783135397.999989:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1783135398.000732:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783135398.000760:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1783135398.000837:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1783135398.001610:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1783135398.001632:0:6516:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.106@tcp 20000000:01000000:0.0:1783135398.001634:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:0.0:1783135398.001650:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1783135398.001657:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783135398.001670:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1783135398.001676:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:0.0:1783135398.001690:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1783135398.001698:0:6516:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1783135398.001712:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1783135398.001728:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1783135398.001743:0:6516:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783135398.001746:0:6516:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783135398.001750:0:6516:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783135398.002707:0:6516:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783135398.002712:0:6516:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783135398.003580:0:9524:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1783135398.003625:0:9524:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1783135398.003643:0:9524:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1783135398.003910:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1783135398.003936:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1783135398.003952:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1783135398.003961:0:6516:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783135398.003963:0:6516:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783135398.004953:0:9525:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1783135398.005339:0:9525:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1783135398.005368:0:9525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1783135398.006738:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1783135398.006771:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1783135398.006864:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1783135398.006877:0:6516:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783135398.006880:0:6516:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783135398.007687:0:9526:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1783135398.007717:0:9526:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1783135398.007733:0:9526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1783135398.008025:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1783135398.008051:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1783135398.008068:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1783135398.008080:0:6516:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783135398.008082:0:6516:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783135398.008634:0:9527:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1783135398.008799:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1783135398.008832:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1783135398.008848:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1783135398.008871:0:6516:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783135398.008873:0:6516:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783135398.009881:0:9528:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1783135398.009934:0:9528:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1783135398.009949:0:9528:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1783135398.010314:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1783135398.010341:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1783135398.010358:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:2.0:1783135398.010375:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783135398.010394:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010424:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf72a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010432:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf75b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf754 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010438:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac640030600/0xf7de4ef628edf79a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf793 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010444:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac640031600/0xf7de4ef628edf7b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf7af expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010452:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c65c800/0xf7de4ef628edf7e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf7d9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010458:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c51b000/0xf7de4ef628edf7fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf7f5 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010464:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edf826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf81f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010472:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010516:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edf826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf81f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010534:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edf826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf81f expref: 21 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135398.010561:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643475c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809065472:0@lo:104: 00000100:00100000:2.0:1783135398.010643:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135398.010702:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c51b000/0xf7de4ef628edf7fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf7f5 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010710:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c51b000/0xf7de4ef628edf7fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf7f5 expref: 21 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135398.010718:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643475180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809065600:0@lo:104: 00000100:00100000:2.0:1783135398.010740:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135398.010763:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c65c800/0xf7de4ef628edf7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf7d9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010771:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c65c800/0xf7de4ef628edf7e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf7d9 expref: 21 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135398.010779:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809065728:0@lo:104: 00000100:00100000:2.0:1783135398.010799:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135398.010815:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac640031600/0xf7de4ef628edf7b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf7af expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010823:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac640031600/0xf7de4ef628edf7b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf7af expref: 21 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135398.010831:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809065856:0@lo:104: 00000100:00100000:2.0:1783135398.010850:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135398.010867:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac640030600/0xf7de4ef628edf79a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf793 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010885:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac640030600/0xf7de4ef628edf79a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf793 expref: 21 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135398.010894:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809065984:0@lo:104: 00000100:00100000:2.0:1783135398.010916:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135398.010933:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf754 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010941:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf75b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf754 expref: 21 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135398.010948:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809066112:0@lo:104: 00000100:00100000:2.0:1783135398.010968:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135398.010982:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf72a expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.010989:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf72a expref: 21 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135398.010997:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809066240:0@lo:104: 00000100:00100000:2.0:1783135398.011028:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672de46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135398.011354:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783135398.011375:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135398.011401:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809065472 00000100:00100000:0.0:1783135398.011409:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809065472 00000100:00100000:0.0:1783135398.011449:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809065600 00000100:00100000:0.0:1783135398.011453:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809065600 00000100:00100000:0.0:1783135398.011463:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809065728 00000100:00100000:0.0:1783135398.011465:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809065728 00000100:00100000:0.0:1783135398.011474:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809065856 00000100:00100000:0.0:1783135398.011476:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809065856 00000100:00100000:0.0:1783135398.011484:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809065984 00000100:00100000:0.0:1783135398.011486:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809065984 00000100:00100000:0.0:1783135398.011495:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809066112 00000100:00100000:0.0:1783135398.011497:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809066112 00000100:00100000:0.0:1783135398.011505:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809066240 00000100:00100000:0.0:1783135398.011507:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809066240 00000100:00100000:0.0:1783135398.011519:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783135398.011529:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:6516:x1869752809065472:12345-0@lo:104: 00010000:00010000:0.0:1783135398.011543:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.011607:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135398.011613:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:6516:x1869752809065472:12345-0@lo:104: Request processed in 86us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.011620:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783135398.011638:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135398.011644:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+8:6516:x1869752809065600:12345-0@lo:104: 00010000:00010000:0.0:1783135398.011651:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.011684:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783135398.011689:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+8:6516:x1869752809065600:12345-0@lo:104: Request processed in 47us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.011705:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135398.011719:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783135398.011726:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+7:6516:x1869752809065728:12345-0@lo:104: 00010000:00010000:0.0:1783135398.011734:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.011780:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783135398.011785:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+7:6516:x1869752809065728:12345-0@lo:104: Request processed in 61us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.011789:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783135398.011801:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783135398.011807:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:6516:x1869752809065856:12345-0@lo:104: 00010000:00010000:0.0:1783135398.011814:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.011844:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783135398.011849:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:6516:x1869752809065856:12345-0@lo:104: Request processed in 43us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.011853:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783135398.011863:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135398.011868:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:6516:x1869752809065984:12345-0@lo:104: 00010000:00010000:0.0:1783135398.011874:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.011899:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783135398.011903:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:6516:x1869752809065984:12345-0@lo:104: Request processed in 36us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.011916:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135398.011928:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783135398.011934:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6516:x1869752809066112:12345-0@lo:104: 00010000:00010000:0.0:1783135398.011941:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.011965:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1783135398.011970:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6516:x1869752809066112:12345-0@lo:104: Request processed in 37us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.011974:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783135398.011999:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783135398.012230:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6516:x1869752809066240:12345-0@lo:104: 00010000:00010000:0.0:1783135398.012240:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012271:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1783135398.012276:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6516:x1869752809066240:12345-0@lo:104: Request processed in 272us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.012282:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1783135398.012301:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783135398.012307:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012315:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526400 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135398.012319:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012340:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135398.012347:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135398.012353:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135398.012395:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012402:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135398.012421:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012428:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628edf81f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf826 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012445:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783135398.012448:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012453:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b400 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135398.012456:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012462:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135398.012469:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135398.012481:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135398.012495:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012501:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135398.012513:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012519:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf7f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012529:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783135398.012531:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012537:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a400 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135398.012540:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012546:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135398.012552:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135398.012557:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135398.012568:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012574:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135398.012586:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012592:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf7d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012600:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783135398.012603:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012609:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030000 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135398.012612:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012619:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135398.012626:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135398.012631:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135398.012643:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012649:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135398.012653:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012658:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac640030000/0xf7de4ef628edf7af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7b6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012669:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783135398.012678:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012684:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135398.012687:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012693:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135398.012699:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135398.012705:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135398.012716:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012722:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135398.012726:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012732:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf79a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012740:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135398.012744:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012750:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135398.012752:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012769:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135398.012776:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135398.012780:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135398.012793:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012798:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135398.012801:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012807:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac650988400/0xf7de4ef628edf754 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf75b expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012817:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135398.012820:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012825:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a200 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135398.012828:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012834:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135398.012841:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135398.012850:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135398.012862:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012867:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135398.012871:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012878:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf72a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf731 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.012890:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135398.012892:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135398.012894:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135398.012902:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135398.012907:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135398.012919:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809066368:0@lo:103: 00000100:00100000:0.0:1783135398.012957:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135398.012980:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809066880:0@lo:103: 00000100:00100000:0.0:1783135398.012997:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135398.013027:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135398.013032:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809066752:0@lo:103: 00000100:00100000:0.0:1783135398.013049:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135398.013077:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809066368 00000100:00100000:0.0:1783135398.013083:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809066368 00000100:00100000:2.0:1783135398.013455:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643475c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809065472:0@lo:104: 00000100:00100000:2.0:1783135398.013465:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643475180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809065600:0@lo:104: 00000100:00100000:2.0:1783135398.013472:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809065728:0@lo:104: 00000100:00100000:2.0:1783135398.013480:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809065856:0@lo:104: 00000100:00100000:2.0:1783135398.013489:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809065984:0@lo:104: 00000100:00100000:2.0:1783135398.013507:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809066112:0@lo:104: 00000100:00100000:2.0:1783135398.013514:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6516:1869752809066240:0@lo:104: 00010000:00010000:2.0:1783135398.013552:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135398.013645:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809066496:0@lo:103: 00000100:00100000:3.0:1783135398.013685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.013698:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809067008:0@lo:103: 00000100:00100000:3.0:1783135398.013716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.013729:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783135398.013734:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809066624:0@lo:103: 00000100:00100000:3.0:1783135398.013752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.013759:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809067136:0@lo:103: 00000100:00100000:3.0:1783135398.013774:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.013814:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809066880 00000100:00100000:3.0:1783135398.013818:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809066880 00010000:00010000:3.0:1783135398.013849:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac640030600/0xf7de4ef628edf79a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf793 expref: 23 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135398.013870:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809066752 00000100:00100000:3.0:1783135398.013873:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809066752 00010000:00010000:3.0:1783135398.013884:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac640031600/0xf7de4ef628edf7b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf7af expref: 24 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135398.013894:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809066496 00000100:00100000:3.0:1783135398.013896:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809066496 00010000:00010000:3.0:1783135398.013906:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c51b000/0xf7de4ef628edf7fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf7f5 expref: 25 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135398.013916:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809067008 00000100:00100000:3.0:1783135398.013925:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809067008 00010000:00010000:3.0:1783135398.013940:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf75b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf754 expref: 26 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135398.013950:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809066624 00000100:00100000:3.0:1783135398.013953:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809066624 00010000:00010000:3.0:1783135398.013963:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c65c800/0xf7de4ef628edf7e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf7d9 expref: 27 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135398.013972:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809067136 00000100:00100000:3.0:1783135398.013975:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809067136 00010000:00010000:3.0:1783135398.013985:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf72a expref: 28 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135398.013998:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135398.014023:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+28:3649:x1869752809066880:12345-0@lo:103: 00010000:00010000:3.0:1783135398.014037:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135398.014043:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac640030600/0xf7de4ef628edf79a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf793 expref: 28 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014054:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac640030600/0xf7de4ef628edf79a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf793 expref: 28 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014069:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac640030600/0xf7de4ef628edf79a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf793 expref: 28 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014115:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135398.014243:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+27:3649:x1869752809066880:12345-0@lo:103: Request processed in 235us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.014252:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135398.014272:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135398.014287:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+26:3649:x1869752809066752:12345-0@lo:103: 00010000:00010000:3.0:1783135398.014296:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135398.014300:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac640031600/0xf7de4ef628edf7b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf7af expref: 26 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014310:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac640031600/0xf7de4ef628edf7b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf7af expref: 26 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014321:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac640031600/0xf7de4ef628edf7b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf7af expref: 26 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014329:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135398.014353:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:3649:x1869752809066752:12345-0@lo:103: Request processed in 69us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.014359:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135398.014372:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135398.014379:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65807d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809066496:12345-0@lo:103: 00010000:00010000:3.0:1783135398.014388:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135398.014393:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c51b000/0xf7de4ef628edf7fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf7f5 expref: 24 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014401:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c51b000/0xf7de4ef628edf7fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf7f5 expref: 24 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014412:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51b000/0xf7de4ef628edf7fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf7f5 expref: 24 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014420:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135398.014450:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65807d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:3646:x1869752809066496:12345-0@lo:103: Request processed in 72us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.014467:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135398.014481:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135398.014488:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:3646:x1869752809067008:12345-0@lo:103: 00010000:00010000:3.0:1783135398.014496:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135398.014501:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf75b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf754 expref: 22 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014510:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf754 expref: 22 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014520:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac640031200/0xf7de4ef628edf75b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf754 expref: 22 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014530:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135398.014553:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3646:x1869752809067008:12345-0@lo:103: Request processed in 67us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.014559:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135398.014572:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135398.014580:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:3646:x1869752809066624:12345-0@lo:103: 00010000:00010000:3.0:1783135398.014587:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135398.014591:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c65c800/0xf7de4ef628edf7e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf7d9 expref: 20 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014599:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c65c800/0xf7de4ef628edf7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf7d9 expref: 20 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014609:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65c800/0xf7de4ef628edf7e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf7d9 expref: 20 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014630:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135398.014654:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:3646:x1869752809066624:12345-0@lo:103: Request processed in 76us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.014660:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135398.014673:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783135398.014680:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:3646:x1869752809067136:12345-0@lo:103: 00010000:00010000:3.0:1783135398.014687:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135398.014691:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf72a expref: 18 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014699:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf72a expref: 18 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014708:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf72a expref: 18 pid: 6516 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.014716:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135398.014738:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:3646:x1869752809067136:12345-0@lo:103: Request processed in 59us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.014744:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783135398.014777:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809066624:0@lo:103: 00000100:00100000:3.0:1783135398.014784:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809067136:0@lo:103: 00000100:00100000:3.0:1783135398.014790:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809066496:0@lo:103: 00000100:00100000:3.0:1783135398.014796:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809067008:0@lo:103: 00000100:00100000:2.0:1783135398.014974:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809066752:0@lo:103: 00000100:00100000:2.0:1783135398.014984:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809066880:0@lo:103: 00010000:00010000:0.0:1783135398.016478:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edf826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf81f expref: 16 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135398.016555:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783135398.016572:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:3649:x1869752809066368:12345-0@lo:103: 00010000:00010000:0.0:1783135398.016587:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135398.016593:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edf826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf81f expref: 16 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016605:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edf826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf81f expref: 16 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016623:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edf826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf81f expref: 16 pid: 6517 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016644:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016654:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016672:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016679:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016687:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016694:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016711:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989000 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135398.016716:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016725:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016745:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.016758:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135398.016857:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3649:x1869752809066368:12345-0@lo:103: Request processed in 292us (3897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.016864:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783135398.016956:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809066368:0@lo:103: 00010000:00010000:2.0:1783135398.017240:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.017250:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.017257:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf83b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135398.017275:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1783135398.017436:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135398.020664:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:9518:x1869752809065344:12345-0@lo:253: Request processed in 22063us (22720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135398.020683:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1783135398.020826:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809065344:0@lo:253: 10000000:01000000:3.0:1783135398.020854:0:9518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783135398.020857:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135398.020859:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135398.020860:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135398.020861:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1783135398.020863:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135398.020864:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135398.020865:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135398.020867:0:9518:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783135398.020868:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135398.020869:0:9518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783135398.020889:0:9518:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ac67e2d9800 from lustre-OST0001 10000000:01000000:3.0:1783135398.020919:0:9518:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783135398.020921:0:9518:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783135398.020930:0:9518:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ac66b5899c0 local copy 10000000:01000000:3.0:1783135398.020933:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783135398.020964:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.020975:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.020985:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135398.021003:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809067264:0@lo:101: 00000100:00100000:3.0:1783135398.021047:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.021081:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135398.021352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809067264 00000100:00100000:2.0:1783135398.021359:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809067264 00000100:00100000:2.0:1783135398.021412:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783135398.021422:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+14:9518:x1869752809067264:12345-0@lo:101: 00010000:00010000:2.0:1783135398.021436:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135398.021451:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf842 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.021487:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf842 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.021497:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf842 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135398.021506:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989600, rc 0) 00000100:00100000:2.0:1783135398.021535:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809067264:12345-0@lo:101: Request processed in 115us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135398.021541:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783135398.021620:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809067264:0@lo:101: 00010000:00010000:1.0:1783135398.021633:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.021641:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135398.021730:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809067392:0@lo:501: 00000100:00100000:1.0:1783135398.021755:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.021789:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135398.021877:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809067392 00000100:00100000:2.0:1783135398.021882:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809067392 00000100:00100000:2.0:1783135398.021960:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783135398.021967:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809067392:12345-0@lo:501: 00000100:00100000:2.0:1783135398.022042:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809067392:12345-0@lo:501: Request processed in 75us (285us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135398.022050:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783135398.022593:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809067392:0@lo:501: 10000000:01000000:1.0:1783135398.022610:0:9518:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783135398.022633:0:9518:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783135398.022638:0:9518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.022647:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.022654:0:9518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.022686:0:9518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783135398.022710:0:9518:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ac67e2d9800 10000000:01000000:1.0:1783135398.022715:0:9518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783135398.022721:0:9518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783135398.022724:0:9518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135398.022729:0:9518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1783135398.022731:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783135398.022752:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.022760:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.022770:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135398.022797:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809067520:0@lo:101: 00000100:00100000:1.0:1783135398.022829:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.023608:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135398.023700:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809067520 00000100:00100000:0.0:1783135398.023708:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809067520 00000100:00100000:0.0:1783135398.023749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783135398.023758:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809067520:12345-0@lo:101: 00010000:00010000:0.0:1783135398.023772:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135398.023867:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edf857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf850 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.023895:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edf857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf850 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.023907:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edf857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf850 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.023930:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65dc00, rc 0) 00000100:00100000:0.0:1783135398.024363:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809067520:12345-0@lo:101: Request processed in 604us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.024372:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:0.0:1783135398.024408:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135398.024414:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.024422:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526800 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135398.024426:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.024435:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135398.024442:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135398.024447:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135398.024472:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.024478:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135398.024508:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.024515:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c526800/0xf7de4ef628edf842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf7de4ef628edf849 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.024537:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135398.024539:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135398.024541:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135398.024550:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135398.024567:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809067648:0@lo:103: 00000100:00100000:0.0:1783135398.024607:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135398.024639:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809067648 00000100:00100000:0.0:1783135398.024643:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809067648 00000100:00100000:0.0:1783135398.024674:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135398.024680:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:3649:x1869752809067648:12345-0@lo:103: 00010000:00010000:0.0:1783135398.024689:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135398.024704:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf842 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.024716:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135398.024744:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3649:x1869752809067648:12345-0@lo:103: Request processed in 63us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.024750:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135398.024868:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809067648:0@lo:103: 00000100:00100000:1.0:1783135398.025350:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809067520:0@lo:101: 00010000:00010000:1.0:1783135398.025367:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.025376:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135398.025468:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809067776:0@lo:501: 00000100:00100000:1.0:1783135398.025510:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.025547:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135398.025611:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809067776 00000100:00100000:3.0:1783135398.025617:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809067776 00000100:00100000:3.0:1783135398.025662:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783135398.025671:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809067776:12345-0@lo:501: 00000100:00100000:3.0:1783135398.025930:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809067776:12345-0@lo:501: Request processed in 260us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.025939:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783135398.026298:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809067776:0@lo:501: 00000100:00100000:1.0:1783135398.026332:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809067904:0@lo:503: 00000100:00100000:1.0:1783135398.026374:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.026435:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135398.026476:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809067904 00000100:00100000:2.0:1783135398.026482:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809067904 00000100:00100000:2.0:1783135398.026546:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783135398.026554:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809067904:12345-0@lo:503: 00000100:00100000:2.0:1783135398.026645:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809067904:12345-0@lo:503: Request processed in 91us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135398.026651:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783135398.026723:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809067904:0@lo:503: 00000040:00080000:1.0:1783135398.027032:0:9518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135398.027138:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068032:0@lo:502: 00000100:00100000:1.0:1783135398.027174:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.027927:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135398.027969:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809068032 00000100:00100000:0.0:1783135398.027976:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809068032 00000100:00100000:0.0:1783135398.028021:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783135398.028030:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809068032:12345-0@lo:502: 00000100:00100000:0.0:1783135398.028362:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809068032:12345-0@lo:502: Request processed in 332us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.028371:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1783135398.028478:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068032:0@lo:502: 00000040:00080000:1.0:1783135398.028724:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783135398.028755:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1783135398.028768:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1783135398.028795:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1783135398.028811:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1783135398.028824:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1783135398.028854:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068160:0@lo:502: 00000100:00100000:1.0:1783135398.028895:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.028929:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135398.029180:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809068160 00000100:00100000:0.0:1783135398.029186:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809068160 00000100:00100000:0.0:1783135398.029215:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783135398.029222:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809068160:12345-0@lo:502: 00000100:00100000:0.0:1783135398.029307:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809068160:12345-0@lo:502: Request processed in 85us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.029314:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783135398.029531:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068160:0@lo:502: 00000040:00080000:1.0:1783135398.029582:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1783135398.029593:0:9518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1783135398.031988:0:9529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783135398.032319:0:9529:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1783135398.032329:0:9529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135398.032332:0:9529:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783135398.032340:0:9529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135398.032360:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ac658010000) 00000020:00000080:3.0:1783135398.032385:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783135398.032391:0:9529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783135398.032469:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac67e2d9800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783135398.032477:0:9529:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783135398.032483:0:9529:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7de4ef628edf865 00010000:00010000:3.0:1783135398.041755:0:9529:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1783135398.042451:0:9529:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1783135398.046973:0:9529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1783135398.047560:0:9529:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1783135398.064274:0:9529:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1783135398.064610:0:9529:0:(osd_compat.c:1271:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1783135398.076454:0:9529:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1783135398.083664:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783135398.083679:0:9529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135398.083685:0:9529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135398.083687:0:9529:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783135398.083691:0:9529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135398.083696:0:9529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135398.083698:0:9529:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135398.083701:0:9529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135398.083703:0:9529:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783135398.083729:0:9529:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135398.083732:0:9529:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135398.083733:0:9529:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783135398.083736:0:9529:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1783135398.083901:0:9518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1783135398.083926:0:9518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783135398.083952:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.083971:0:9518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135398.083979:0:9518:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac67e2d9800 from 1 10000000:01000000:1.0:1783135398.083982:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135398.084038:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.084047:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.084057:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135398.084080:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068288:0@lo:101: 00000100:00100000:1.0:1783135398.084754:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.084815:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135398.084932:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809068288 00000100:00100000:3.0:1783135398.084942:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809068288 00000100:00100000:3.0:1783135398.085013:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783135398.085023:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:9518:x1869752809068288:12345-0@lo:101: 00010000:00010000:3.0:1783135398.085038:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135398.085052:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf873 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf86c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.085080:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf86c expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.085282:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf86c expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.085292:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527400, rc 0) 00000100:00100000:3.0:1783135398.085340:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809068288:12345-0@lo:101: Request processed in 318us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.085348:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783135398.085545:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068288:0@lo:101: 00010000:00010000:1.0:1783135398.085561:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.085571:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135398.085681:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068416:0@lo:501: 00000100:00100000:1.0:1783135398.085708:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.085728:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135398.085954:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809068416 00000100:00100000:3.0:1783135398.085959:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809068416 00000100:00100000:3.0:1783135398.086016:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783135398.086024:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809068416:12345-0@lo:501: 00000100:00100000:2.0:1783135398.086474:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809068416:12345-0@lo:501: Request processed in 449us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135398.086483:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783135398.086851:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068416:0@lo:501: 00000100:00100000:3.0:1783135398.086892:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068544:0@lo:503: 00000100:00100000:3.0:1783135398.086937:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.086968:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135398.087498:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809068544 00000100:00100000:2.0:1783135398.087506:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809068544 00000100:00100000:2.0:1783135398.087551:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783135398.087559:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809068544:12345-0@lo:503: 00000100:00100000:2.0:1783135398.087679:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809068544:12345-0@lo:503: Request processed in 120us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135398.087686:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783135398.087788:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068544:0@lo:503: 00000040:00080000:3.0:1783135398.088067:0:9518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135398.088430:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068672:0@lo:502: 00000100:00100000:2.0:1783135398.088476:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135398.088512:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c481480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135398.088660:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809068672 00000100:00100000:1.0:1783135398.088666:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809068672 00000100:00100000:1.0:1783135398.088707:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783135398.088716:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809068672:12345-0@lo:502: 00000100:00100000:1.0:1783135398.088813:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809068672:12345-0@lo:502: Request processed in 97us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135398.088820:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1783135398.088868:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068672:0@lo:502: 00000040:00080000:1.0:1783135398.089075:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1783135398.089273:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1783135398.089300:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068800:0@lo:502: 00000100:00100000:1.0:1783135398.089338:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.089356:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135398.089374:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809068800 00000100:00100000:1.0:1783135398.089378:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809068800 00000100:00100000:1.0:1783135398.089397:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783135398.089403:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809068800:12345-0@lo:502: 00000100:00100000:1.0:1783135398.089471:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809068800:12345-0@lo:502: Request processed in 67us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135398.089478:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783135398.089520:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068800:0@lo:502: 00000040:00080000:1.0:1783135398.089556:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783135398.089565:0:9518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1783135398.092599:0:9532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135398.092617:0:9532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135398.092620:0:9532:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783135398.092628:0:9532:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac67e2d9800 00000020:00000080:3.0:1783135398.092631:0:9532:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135398.092644:0:9532:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135398.092646:0:9532:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135398.092648:0:9532:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783135398.092651:0:9532:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783135398.095244:0:9518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783135398.095289:0:9518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135398.095319:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.095347:0:9518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135398.095416:0:9518:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783135398.095419:0:9518:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ac67e2d9800 10000000:01000000:1.0:1783135398.095423:0:9518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ac67e2d9800 10000000:01000000:1.0:1783135398.095427:0:9518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135398.095432:0:9518:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac67e2d9800 from 1 10000000:01000000:1.0:1783135398.095435:0:9518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135398.095473:0:9518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.095481:0:9518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.095492:0:9518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135398.095517:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068928:0@lo:101: 00000100:00100000:1.0:1783135398.095596:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.095642:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135398.095668:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809068928 00000100:00100000:1.0:1783135398.095676:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809068928 00000100:00100000:1.0:1783135398.095723:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783135398.095733:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9518:x1869752809068928:12345-0@lo:101: 00010000:00010000:1.0:1783135398.095748:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135398.095760:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edf881 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf87a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.095796:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edf881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf87a expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.095805:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edf881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf87a expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.095814:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a800, rc 0) 00000100:00100000:1.0:1783135398.095852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809068928:12345-0@lo:101: Request processed in 120us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135398.095859:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783135398.095911:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809068928:0@lo:101: 00010000:00010000:1.0:1783135398.095926:0:9518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.095937:0:9518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135398.096035:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809069056:0@lo:501: 00000100:00100000:1.0:1783135398.096061:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.097378:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135398.097541:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809069056 00000100:00100000:3.0:1783135398.097557:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809069056 00000100:00100000:3.0:1783135398.097613:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783135398.097621:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809069056:12345-0@lo:501: 00000100:00100000:3.0:1783135398.097855:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809069056:12345-0@lo:501: Request processed in 234us (1792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.097863:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783135398.101367:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809069056:0@lo:501: 00000100:00100000:0.0:1783135398.101443:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809069184:0@lo:503: 00000100:00100000:0.0:1783135398.101531:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135398.101958:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646dd89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135398.108350:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809069184 00000100:00100000:3.0:1783135398.108369:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809069184 00000100:00100000:2.0:1783135398.108507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783135398.108518:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809069184:12345-0@lo:503: 00000100:00100000:2.0:1783135398.108716:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809069184:12345-0@lo:503: Request processed in 198us (7183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135398.108731:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783135398.108753:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809069184:0@lo:503: 00000040:00080000:1.0:1783135398.109068:0:9518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135398.109198:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809069312:0@lo:502: 00000100:00100000:1.0:1783135398.109256:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.109290:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135398.109400:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809069312 00000100:00100000:3.0:1783135398.109406:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809069312 00000100:00100000:3.0:1783135398.109448:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783135398.109457:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809069312:12345-0@lo:502: 00000100:00100000:3.0:1783135398.109570:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809069312:12345-0@lo:502: Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.109577:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783135398.109821:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809069312:0@lo:502: 00000040:00080000:2.0:1783135398.110041:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783135398.110070:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783135398.110083:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783135398.110263:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783135398.110281:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783135398.110295:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783135398.110308:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783135398.110320:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783135398.110333:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783135398.110345:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783135398.110359:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783135398.110372:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783135398.110386:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783135398.110399:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783135398.110412:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783135398.110425:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783135398.110436:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783135398.110448:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783135398.110460:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783135398.110487:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783135398.110502:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783135398.110514:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783135398.110526:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783135398.110539:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783135398.110550:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1783135398.110563:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1783135398.110575:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1783135398.110587:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1783135398.110600:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1783135398.110623:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1783135398.110635:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1783135398.110647:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1783135398.110658:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1783135398.110669:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1783135398.110681:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1783135398.110703:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1783135398.110717:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1783135398.110730:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1783135398.110742:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1783135398.110753:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1783135398.110764:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1783135398.110776:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1783135398.110789:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1783135398.110803:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1783135398.110815:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1783135398.110828:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1783135398.110858:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809069440:0@lo:502: 00000100:00100000:2.0:1783135398.110915:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135398.110955:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c481780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135398.112176:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809069440 00000100:00100000:1.0:1783135398.112202:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809069440 00000100:00100000:1.0:1783135398.112272:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783135398.112282:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809069440:12345-0@lo:502: 00000100:00100000:1.0:1783135398.112538:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809069440:12345-0@lo:502: Request processed in 257us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135398.112546:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783135398.112618:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809069440:0@lo:502: 00000040:00080000:1.0:1783135398.112700:0:9518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1783135398.112714:0:9518:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1783135398.117382:0:9534:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783135398.117409:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ac54359cd40) 00000020:00000080:2.0:1783135398.117435:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1783135398.117613:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac67e2d9800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783135398.117617:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac67e2d9800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783135398.117620:0:9534:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac67e2d9800 3 00010000:00080000:2.0:1783135398.117649:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac67c6f8800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.106@tcp at head 00010000:00010000:2.0:1783135398.124321:0:9534:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1783135398.124464:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783135398.124521:0:9534:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783135398.124536:0:9534:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf7de4ef628edf88f 00000100:00080000:2.0:1783135398.124557:0:9534:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135398.124564:0:9534:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ac67c6f8800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135398.124605:0:9534:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac541d90000 x1869752809069568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135398.124684:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869752809069568:0@lo:38: 00000100:00100000:3.0:1783135398.124773:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783135398.124846:0:9534:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783135398.131276:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809069568 00000100:00100000:1.0:1783135398.131291:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809069568 00000100:00100000:1.0:1783135398.131341:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135398.131361:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869752809069568:12345-0@lo:38: 00010000:00080000:1.0:1783135398.131390:0:8461:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:1.0:1783135398.131430:0:8461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf7de4ef628edf896 00000004:00100000:1.0:1783135398.131446:0:8461:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783135398.131481:0:8461:0:(import.c:65:import_set_state_nolock()) ffff8ac5430d7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135398.131487:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809069696:0@lo:400: 00000100:00100000:3.0:1783135398.131571:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809070080:0@lo:400: 00000100:00100000:2.0:1783135398.132161:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809069952:0@lo:400: 00000100:00100000:1.0:1783135398.137825:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869752809069568:12345-0@lo:38: Request processed in 6451us (13040us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135398.137841:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135398.138119:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.138254:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809070080 00000100:00100000:3.0:1783135398.138264:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809070080 00000100:00100000:3.0:1783135398.138322:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135398.138333:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809070080:12345-0@lo:400: 00000100:00100000:3.0:1783135398.138396:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809070080:12345-0@lo:400: Request processed in 65us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.138402:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1783135398.138462:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d90000 x1869752809069568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135398.138482:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135398.138495:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1783135398.138503:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783135398.138508:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783135398.138512:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783135398.138519:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869752809069568:0@lo:38: 00010000:00080000:3.0:1783135398.138554:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d92680 x1869752809070080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135398.138564:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809070080:0@lo:400: 00000020:01000004:3.0:1783135398.138693:0:9534:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783135398.138711:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ac658013380) 00000020:00000080:3.0:1783135398.138736:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1783135398.138946:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac67e2d9800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783135398.138950:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac67e2d9800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783135398.138953:0:9534:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac67e2d9800 3 00010000:00080000:3.0:1783135398.138981:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac67c165000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.106@tcp at head 00010000:00010000:3.0:1783135398.142020:0:9534:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:2.0:1783135398.143726:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135398.143798:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809070464:0@lo:400: 00000100:00100000:2.0:1783135398.143851:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135398.143883:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783135398.143890:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809069824:0@lo:400: 00000100:00100000:2.0:1783135398.143931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135398.143962:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809070336:0@lo:400: 00000100:00100000:2.0:1783135398.143987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135398.144240:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809070464 00000100:00100000:2.0:1783135398.144249:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809070464 00000100:00100000:2.0:1783135398.144299:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809070336 00000100:00100000:2.0:1783135398.144302:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809070336 00000100:00100000:2.0:1783135398.144330:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135398.144338:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809070464:12345-0@lo:400: 00000100:00100000:2.0:1783135398.144397:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809070464:12345-0@lo:400: Request processed in 59us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135398.144406:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135398.144422:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135398.144428:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809070336:12345-0@lo:400: 00000100:00100000:2.0:1783135398.144458:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809070336:12345-0@lo:400: Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135398.144472:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783135398.144520:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d91c00 x1869752809070336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135398.144536:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809070336:0@lo:400: 00010000:00080000:2.0:1783135398.144548:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac643474700 x1869752809070464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135398.144556:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809070464:0@lo:400: 00000020:00000080:3.0:1783135398.145860:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1783135398.145925:0:9534:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783135398.145942:0:9534:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf7de4ef628edf8a4 00000100:00080000:3.0:1783135398.145951:0:9534:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135398.145957:0:9534:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ac67c165000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135398.145994:0:9534:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac6434e0a80 x1869752809070592/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135398.146241:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.146294:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809069952 00000100:00100000:0.0:1783135398.146295:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809069824 00000100:00100000:1.0:1783135398.146301:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809069952 00000100:00100000:0.0:1783135398.146301:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809069824 00000100:00100000:1.0:1783135398.146338:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809069696 00000100:00100000:1.0:1783135398.146341:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809069696 00000100:00100000:0.0:1783135398.146342:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783135398.146360:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135398.146368:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809069952:12345-0@lo:400: 00000100:00100000:1.0:1783135398.146436:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809069952:12345-0@lo:400: Request processed in 69us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135398.146450:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135398.146465:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135398.146472:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809069696:12345-0@lo:400: 00000100:00100000:1.0:1783135398.146502:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809069696:12345-0@lo:400: Request processed in 31us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135398.146507:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1783135398.146560:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d93800 x1869752809069952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135398.146574:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809069952:0@lo:400: 00000100:00100000:0.0:1783135398.146582:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809069824:12345-0@lo:400: 00000100:00100000:0.0:1783135398.146625:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809069824:12345-0@lo:400: Request processed in 46us (2693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.146631:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1783135398.146665:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135398.146670:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135398.146693:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809069824:0@lo:400: 00010000:00080000:0.0:1783135398.146717:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d90700 x1869752809069696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135398.146725:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809069696:0@lo:400: 00000100:00100000:0.0:1783135398.146742:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809070208:0@lo:400: 00000100:00100000:0.0:1783135398.146773:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135398.146792:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809070208 00000100:00100000:0.0:1783135398.146796:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809070208 00000100:00100000:0.0:1783135398.146833:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783135398.146839:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809070208:12345-0@lo:400: 00000100:00100000:0.0:1783135398.146865:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809070208:12345-0@lo:400: Request processed in 27us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.146871:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1783135398.146884:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783135398.146900:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac541d90380 x1869752809070208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135398.146909:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809070208:0@lo:400: 00000100:00080000:3.0:1783135398.147469:0:9534:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1783135398.147580:0:9536:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9536:1869752809070720:0@lo:901: 00000100:00100000:3.0:1783135398.147616:0:9536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.147643:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809070720 00000100:00100000:3.0:1783135398.147648:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809070720 00000100:00100000:3.0:1783135398.147685:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135398.147693:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9536:x1869752809070720:12345-0@lo:901: 00000100:00100000:3.0:1783135398.147768:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9536:x1869752809070720:12345-0@lo:901: Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.147790:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783135398.147807:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135398.147818:0:9536:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dacd80 going to sleep for 11 seconds 00010000:00080000:3.0:1783135398.147834:0:9536:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434e1c00 x1869752809070720/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783135414 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135398.147844:0:9536:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1c00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9536:1869752809070720:0@lo:901: 00000100:00100000:2.0:1783135398.148333:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869752809070592:0@lo:38: 00000100:00100000:2.0:1783135398.148382:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.149444:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809070592 00000100:00100000:3.0:1783135398.149453:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809070592 00000100:00100000:3.0:1783135398.149493:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135398.149500:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869752809070592:12345-0@lo:38: 00010000:00080000:3.0:1783135398.149525:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:3.0:1783135398.149559:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf7de4ef628edf8ab 00000004:00100000:3.0:1783135398.149575:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783135398.149605:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8ac67c2fb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135398.149672:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869752809070592:12345-0@lo:38: Request processed in 172us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.149680:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783135398.149724:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac6434e0a80 x1869752809070592/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135398.149738:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135398.149747:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1783135398.149756:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783135398.149760:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1783135398.149763:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c165000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783135398.149769:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869752809070592:0@lo:38: 00000040:00080000:3.0:1783135398.149987:0:9534:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1783135398.150568:0:9518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1783135398.150606:0:9518:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783135398.150632:0:9518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135398.150644:0:9518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783135398.150692:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783135398.150694:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783135398.150696:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135398.150697:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135398.150699:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135398.150700:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135398.150702:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135398.150704:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783135398.150705:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783135398.150707:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135398.150708:0:9518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135398.150712:0:9518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1783135398.150714:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135398.150719:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783135398.150720:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135398.150721:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135398.150722:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135398.150723:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135398.150724:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135398.150725:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783135398.150726:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783135398.150727:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135398.150728:0:9518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135398.150751:0:9518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783135398.150767:0:9518:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c653480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809070848:0@lo:253: 00000100:00100000:1.0:1783135398.150946:0:9518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.151264:0:9518:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135398.157854:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809070848 00000100:00100000:2.0:1783135398.157869:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809070848 00000100:00100000:2.0:1783135398.157930:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783135398.157942:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809070848:12345-0@lo:253: 20000000:01000000:2.0:1783135398.157981:0:6517:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783135398.158012:0:6517:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783135398.165744:0:6517:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783135398.165770:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783135398.166250:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9518:x1869752809070848:12345-0@lo:253: Request processed in 8303us (15297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135398.166264:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 20000000:01000000:0.0:1783135398.166747:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783135398.166755:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783135398.166778:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.166794:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac640030e00/0xf7de4ef628edf7a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf7a1 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.166803:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf7ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf7e7 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.166811:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.166852:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf7ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf7e7 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.166874:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf7ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf7e7 expref: 16 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135398.166888:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b191180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809070976:0@lo:104: 00000100:00100000:0.0:1783135398.166931:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135398.166982:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac640030e00/0xf7de4ef628edf7a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf7a1 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.166991:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac640030e00/0xf7de4ef628edf7a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf7a1 expref: 16 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135398.167000:0:6538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b191500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809071104:0@lo:104: 00000100:00100000:0.0:1783135398.167031:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135398.167055:0:6538:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646dd89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135398.167241:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809070976 00000100:00100000:3.0:1783135398.167251:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809070976 00000100:00100000:3.0:1783135398.167287:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809071104 00000100:00100000:3.0:1783135398.167290:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809071104 00000100:00100000:3.0:1783135398.167304:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135398.167313:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6538:x1869752809070976:12345-0@lo:104: 00010000:00010000:3.0:1783135398.167326:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167398:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783135398.167404:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:6538:x1869752809070976:12345-0@lo:104: Request processed in 93us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.167412:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135398.167428:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135398.167434:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6538:x1869752809071104:12345-0@lo:104: 00010000:00010000:3.0:1783135398.167442:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167475:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783135398.167488:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:6538:x1869752809071104:12345-0@lo:104: Request processed in 55us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.167495:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1783135398.167512:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135398.167518:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167526:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65de00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135398.167530:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167538:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135398.167545:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135398.167552:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135398.167582:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167589:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135398.167609:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167615:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c65de00/0xf7de4ef628edf7e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167627:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135398.167629:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167645:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988200 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135398.167648:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167654:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135398.167659:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135398.167664:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135398.167677:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167683:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135398.167688:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167694:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628edf7a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf7a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167708:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135398.167710:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135398.167711:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135398.167718:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135398.167738:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809071232:0@lo:103: 00000100:00100000:3.0:1783135398.167770:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.167792:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135398.167798:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809071360:0@lo:103: 00000100:00100000:3.0:1783135398.167826:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.167854:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809071232 00000100:00100000:3.0:1783135398.167858:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809071232 00010000:00010000:3.0:1783135398.167877:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf7ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf7e7 expref: 17 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135398.167896:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809071360 00000100:00100000:3.0:1783135398.167899:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809071360 00010000:00010000:3.0:1783135398.167909:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac640030e00/0xf7de4ef628edf7a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf7a1 expref: 18 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135398.167921:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135398.167926:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:3648:x1869752809071232:12345-0@lo:103: 00010000:00010000:3.0:1783135398.167936:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135398.167940:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf7ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf7e7 expref: 18 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167949:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf7ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf7e7 expref: 18 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.167963:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135398.167989:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:3648:x1869752809071232:12345-0@lo:103: Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.167996:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135398.168022:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135398.168030:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:3648:x1869752809071360:12345-0@lo:103: 00010000:00010000:3.0:1783135398.168037:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135398.168041:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac640030e00/0xf7de4ef628edf7a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf7a1 expref: 17 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.168061:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac640030e00/0xf7de4ef628edf7a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf7a1 expref: 17 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.168073:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.168081:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.168369:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf7ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf7e7 expref: 17 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135398.168382:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b191180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809070976:0@lo:104: 00010000:00010000:0.0:1783135398.168394:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac640030e00/0xf7de4ef628edf7a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf7a1 expref: 16 pid: 6515 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135398.168404:0:6538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b191500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1869752809071104:0@lo:104: 00010000:00010000:0.0:1783135398.168427:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783135398.168495:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006974325s 00010000:00010000:3.0:1783135398.168501:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.168509:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.168516:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.168523:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.168528:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135398.168532:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.168539:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.168561:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135398.168579:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135398.168607:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3648:x1869752809071360:12345-0@lo:103: Request processed in 578us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.168614:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135398.168659:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809071360:0@lo:103: 00000100:00100000:3.0:1783135398.168667:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809071232:0@lo:103: 00010000:00010000:0.0:1783135398.168782:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.168800:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135398.168806:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edf8b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135398.169338:0:9518:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c653480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9518:1869752809070848:0@lo:253: 10000000:01000000:1.0:1783135398.169415:0:9518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783135398.169420:0:9518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135398.169422:0:9518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783135398.169423:0:9518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135398.169425:0:9518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135398.169426:0:9518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135398.169427:0:9518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135398.169429:0:9518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135398.169431:0:9518:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783135398.169432:0:9518:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783135398.169434:0:9518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135398.169435:0:9518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783135398.169446:0:9518:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783135398.183837:0:9518:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1783135398.184015:0:9518:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1783135398.184940:0:9518:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1783135398.185252:0:9518:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1783135398.185490:0:9518:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1783135398.185711:0:9518:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1783135398.189349:0:9518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1783135398.216583:0:9518:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783135398.216595:0:9518:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783135398.216639:0:9518:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783135398.216697:0:9518:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783135398.216717:0:9518:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1783135398.216739:0:9518:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1783135398.217698:0:9518:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783135398.217912:0:9518:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1783135398.769221:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135399.280067:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809071488:0@lo:41: 00000100:00100000:3.0:1783135399.280185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135399.280453:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809071488 00000100:00100000:3.0:1783135399.280465:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809071488 00000100:00100000:3.0:1783135399.280520:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135399.280531:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809071488:12345-0@lo:41: 00000004:00000024:3.0:1783135399.280572:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1783135399.280827:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809071488:12345-0@lo:41: Request processed in 93us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135399.280837:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135399.280898:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809071488:0@lo:41: 00000100:00100000:0.0:1783135399.281046:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809071616:0@lo:13: 00000100:00100000:0.0:1783135399.281120:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135399.281160:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809071616 00000100:00100000:0.0:1783135399.281164:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809071616 00000100:00100000:0.0:1783135399.281330:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135399.281339:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809071616:12345-0@lo:13: 00002000:00000024:0.0:1783135399.281359:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135399.281397:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809071616:12345-0@lo:13: Request processed in 60us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135399.281403:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783135399.281436:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac541d99c00 x1869752809071616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135399.281453:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809071616:0@lo:13: 00000100:00100000:3.0:1783135399.283064:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809071744:0@lo:13: 00000100:00100000:3.0:1783135399.283149:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135399.283437:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809071744 00000100:00100000:1.0:1783135399.283444:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809071744 00000100:00100000:1.0:1783135399.283493:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135399.283503:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809071744:12345-0@lo:13: 00002000:00000024:1.0:1783135399.283522:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135399.283569:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809071744:12345-0@lo:13: Request processed in 68us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135399.283588:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783135399.283897:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c653480 x1869752809071744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135399.283915:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809071744:0@lo:13: 00000020:00000004:0.0:1783135399.350449:0:9591:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783135399.353723:0:9591:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135399.794235:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135400.814540:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135401.859192:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135402.352630:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135402.352676:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809071872:0@lo:41: 00000100:00100000:3.0:1783135402.352782:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135402.352921:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809071872 00000100:00100000:0.0:1783135402.352930:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809071872 00000100:00100000:0.0:1783135402.352987:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783135402.353005:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809071872:12345-0@lo:41: 00000004:00000024:0.0:1783135402.353061:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1783135402.353153:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809071872:12345-0@lo:41: Request processed in 149us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135402.353160:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783135402.353261:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809071872:0@lo:41: 00010000:00010000:3.0:1783135402.863161:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135403.374587:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809072256:0@lo:400: 00000100:00100000:1.0:1783135403.374670:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.374721:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809072768:0@lo:400: 00000100:00100000:1.0:1783135403.374746:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.374766:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809073280:0@lo:400: 00000100:00100000:1.0:1783135403.374788:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.374808:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783135403.374813:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809072384:0@lo:400: 00000100:00100000:1.0:1783135403.374846:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.374861:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809072896:0@lo:400: 00000100:00100000:1.0:1783135403.374882:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.374940:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809072000:0@lo:400: 00000100:00100000:3.0:1783135403.374973:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.374992:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809072512:0@lo:400: 00000100:00100000:3.0:1783135403.375023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.375051:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809073024:0@lo:400: 00000100:00100000:3.0:1783135403.375074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.375119:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783135403.375125:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809072128:0@lo:400: 00000100:00100000:3.0:1783135403.375147:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.375162:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809072640:0@lo:400: 00000100:00100000:3.0:1783135403.375181:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.375189:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809073152:0@lo:400: 00000100:00100000:3.0:1783135403.375207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.375229:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809072768 00000100:00100000:3.0:1783135403.375237:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809072768 00000100:00100000:3.0:1783135403.375289:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809073280 00000100:00100000:3.0:1783135403.375292:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809073280 00000100:00100000:3.0:1783135403.375303:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809072384 00000100:00100000:3.0:1783135403.375305:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809072384 00000100:00100000:3.0:1783135403.375314:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809072128 00000100:00100000:3.0:1783135403.375316:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809072128 00000100:00100000:3.0:1783135403.375325:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809072640 00000100:00100000:3.0:1783135403.375327:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809072640 00000100:00100000:3.0:1783135403.375337:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809073152 00000100:00100000:3.0:1783135403.375339:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809073152 00000100:00100000:3.0:1783135403.375353:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783135403.375370:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809072768:12345-0@lo:400: 00000100:00100000:3.0:1783135403.375433:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809072768:12345-0@lo:400: Request processed in 64us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.375440:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783135403.375458:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135403.375464:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809073280:12345-0@lo:400: 00000100:00100000:3.0:1783135403.375491:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809073280:12345-0@lo:400: Request processed in 28us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.375496:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135403.375508:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783135403.375512:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809072384:12345-0@lo:400: 00000100:00100000:3.0:1783135403.375537:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809072384:12345-0@lo:400: Request processed in 25us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.375543:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783135403.375553:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783135403.375558:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809072128:12345-0@lo:400: 00000100:00100000:3.0:1783135403.375590:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809072128:12345-0@lo:400: Request processed in 32us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.375595:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783135403.375605:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783135403.375610:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809072640:12345-0@lo:400: 00000100:00100000:3.0:1783135403.375655:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809072640:12345-0@lo:400: Request processed in 44us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.375662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783135403.375673:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783135403.375679:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809073152:12345-0@lo:400: 00000100:00100000:3.0:1783135403.375712:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809073152:12345-0@lo:400: Request processed in 33us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.375718:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1783135403.375742:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135403.375748:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1783135403.375784:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c651500 x1869752809072128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135403.375801:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809072128:0@lo:400: 00010000:00080000:3.0:1783135403.375813:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c651880 x1869752809072640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135403.375822:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809072640:0@lo:400: 00010000:00080000:3.0:1783135403.375830:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c650000 x1869752809073152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135403.375838:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809073152:0@lo:400: 00010000:00080000:3.0:1783135403.375873:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c652d80 x1869752809072384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135403.375882:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809072384:0@lo:400: 00010000:00080000:3.0:1783135403.375892:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c653b80 x1869752809072768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135403.375899:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809072768:0@lo:400: 00010000:00080000:3.0:1783135403.375907:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c653480 x1869752809073280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135403.375914:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809073280:0@lo:400: 00000100:00100000:2.0:1783135403.376034:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809072896 00000100:00100000:2.0:1783135403.376040:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809072896 00000100:00100000:2.0:1783135403.376104:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809073024 00000100:00100000:2.0:1783135403.376107:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809073024 00000100:00100000:2.0:1783135403.376131:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135403.376138:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809072896:12345-0@lo:400: 00000100:00100000:2.0:1783135403.376183:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809072896:12345-0@lo:400: Request processed in 45us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135403.376190:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135403.376203:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135403.376209:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809073024:12345-0@lo:400: 00000100:00100000:2.0:1783135403.376241:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809073024:12345-0@lo:400: Request processed in 33us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135403.376247:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135403.376266:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809072000 00000100:00100000:2.0:1783135403.376270:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809072000 00000100:00100000:2.0:1783135403.376294:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783135403.376300:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3646:x1869752809072000:12345-0@lo:400: 00000100:00100000:2.0:1783135403.376330:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3646:x1869752809072000:12345-0@lo:400: Request processed in 30us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135403.376336:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783135403.376392:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809072000:0@lo:400: 00010000:00080000:2.0:1783135403.376403:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c652680 x1869752809073024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135403.376411:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809073024:0@lo:400: 00010000:00080000:2.0:1783135403.376436:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c651c00 x1869752809072896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135403.376444:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809072896:0@lo:400: 00000100:00100000:1.0:1783135403.376530:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809072256 00000100:00100000:1.0:1783135403.376534:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809072256 00000100:00100000:1.0:1783135403.376554:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809072512 00000100:00100000:1.0:1783135403.376556:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809072512 00000100:00100000:1.0:1783135403.376567:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783135403.376573:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809072256:12345-0@lo:400: 00000100:00100000:1.0:1783135403.376608:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809072256:12345-0@lo:400: Request processed in 36us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.376613:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783135403.376623:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783135403.376628:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809072512:12345-0@lo:400: 00000100:00100000:1.0:1783135403.376660:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809072512:12345-0@lo:400: Request processed in 32us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.376666:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783135403.376730:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809072512:0@lo:400: 00000100:00100000:2.0:1783135403.376753:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809072256:0@lo:400: 00000100:00080000:3.0:1783135403.376869:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1783135403.900549:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783135403.900559:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac67c2fd800 from 39 10000000:01000000:1.0:1783135403.900566:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135403.900618:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.900631:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.900643:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135403.900670:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809073408:0@lo:101: 00000100:00100000:1.0:1783135403.900750:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.900811:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dacc00 going to sleep for 11 seconds 00010000:00010000:1.0:1783135403.900831:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135403.901013:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809073408 00000100:00100000:3.0:1783135403.901021:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809073408 00000100:00100000:3.0:1783135403.901119:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783135403.901131:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809073408:12345-0@lo:101: 00010000:00010000:3.0:1783135403.901147:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135403.901160:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527e00/0xf7de4ef628edf8c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf8b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135403.901187:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527e00/0xf7de4ef628edf8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf8b9 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135403.901197:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527e00/0xf7de4ef628edf8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf8b9 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135403.901206:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527e00, rc 0) 00000100:00100000:3.0:1783135403.901251:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809073408:12345-0@lo:101: Request processed in 124us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.901257:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783135403.901369:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809073408:0@lo:101: 00010000:00010000:1.0:1783135403.901386:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.901395:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135403.901463:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809073536:0@lo:501: 00000100:00100000:1.0:1783135403.901489:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.901524:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dacc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135403.901537:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809073536 00000100:00100000:1.0:1783135403.901540:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809073536 00000100:00100000:1.0:1783135403.901573:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783135403.901580:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809073536:12345-0@lo:501: 00000100:00100000:1.0:1783135403.901703:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809073536:12345-0@lo:501: Request processed in 124us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.901710:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783135403.901738:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809073536:0@lo:501: 00000100:00100000:1.0:1783135403.901766:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809073664:0@lo:503: 00000100:00100000:1.0:1783135403.901806:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.901818:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dacc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135403.901828:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809073664 00000100:00100000:1.0:1783135403.901831:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809073664 00000100:00100000:1.0:1783135403.901848:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783135403.901854:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809073664:12345-0@lo:503: 00000100:00100000:1.0:1783135403.901931:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809073664:12345-0@lo:503: Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.901937:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783135403.901972:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809073664:0@lo:503: 00000100:00100000:3.0:1783135403.904804:0:9764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9764:1869752809073792:0@lo:502: 00000100:00100000:3.0:1783135403.904887:0:9764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.904930:0:9764:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135403.904995:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809073792 00000100:00100000:1.0:1783135403.905004:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809073792 00000100:00100000:1.0:1783135403.905062:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783135403.905073:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9764:x1869752809073792:12345-0@lo:502: 00000100:00100000:1.0:1783135403.905254:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9764:x1869752809073792:12345-0@lo:502: Request processed in 181us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.905271:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783135403.905654:0:9764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9764:1869752809073792:0@lo:502: 00000100:00100000:3.0:1783135403.905713:0:9764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9764:1869752809073920:0@lo:502: 00000100:00100000:3.0:1783135403.905749:0:9764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.905784:0:9764:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.905824:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809073920 00000100:00100000:0.0:1783135403.905830:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809073920 00000100:00100000:0.0:1783135403.905865:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783135403.905874:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9764:x1869752809073920:12345-0@lo:502: 00000100:00100000:0.0:1783135403.905961:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:9764:x1869752809073920:12345-0@lo:502: Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.905969:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783135403.906077:0:9764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9764:1869752809073920:0@lo:502: 00000040:00080000:3.0:1783135403.906137:0:9764:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1783135403.906327:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1783135403.906376:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783135403.906386:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.906397:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135403.906405:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783135403.906408:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1783135403.906411:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783135403.906436:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.906444:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.906453:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135403.906467:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074048:0@lo:101: 00000100:00100000:1.0:1783135403.906497:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.906520:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135403.906532:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809074048 00000100:00100000:1.0:1783135403.906536:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809074048 00000100:00100000:1.0:1783135403.906564:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783135403.906570:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809074048:12345-0@lo:101: 00010000:00010000:1.0:1783135403.906579:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135403.906596:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf8ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf8c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.906618:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf8c7 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.906631:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf8c7 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.906639:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a600, rc 0) 00000100:00100000:1.0:1783135403.906668:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809074048:12345-0@lo:101: Request processed in 98us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.906674:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783135403.906705:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074048:0@lo:101: 00010000:00010000:1.0:1783135403.906717:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.906726:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135403.906774:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074176:0@lo:501: 00000100:00100000:1.0:1783135403.906796:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.906808:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135403.906819:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809074176 00000100:00100000:1.0:1783135403.906821:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809074176 00000100:00100000:1.0:1783135403.906840:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783135403.906845:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809074176:12345-0@lo:501: 00000100:00100000:1.0:1783135403.906947:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809074176:12345-0@lo:501: Request processed in 100us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.906962:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783135403.907004:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074176:0@lo:501: 00000100:00100000:1.0:1783135403.907029:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074304:0@lo:503: 00000100:00100000:1.0:1783135403.907064:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.907075:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135403.907113:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809074304 00000100:00100000:1.0:1783135403.907117:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809074304 00000100:00100000:1.0:1783135403.907139:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783135403.907144:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809074304:12345-0@lo:503: 00000100:00100000:1.0:1783135403.907213:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809074304:12345-0@lo:503: Request processed in 68us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.907220:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783135403.907260:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074304:0@lo:503: 00000100:00100000:1.0:1783135403.911928:0:9765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9765:1869752809074432:0@lo:502: 00000100:00100000:1.0:1783135403.912041:0:9765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.912119:0:9765:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.920182:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809074432 00000100:00100000:0.0:1783135403.920201:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809074432 00000100:00100000:0.0:1783135403.920266:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783135403.920276:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9765:x1869752809074432:12345-0@lo:502: 00000100:00100000:0.0:1783135403.920472:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9765:x1869752809074432:12345-0@lo:502: Request processed in 197us (8431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.920481:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783135403.920553:0:9765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9765:1869752809074432:0@lo:502: 00000020:01000000:0.0:1783135403.920588:0:9765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135403.920598:0:9765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135403.920601:0:9765:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783135403.920605:0:9765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783135403.920606:0:9765:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783135403.920633:0:9765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9765:1869752809074560:0@lo:502: 00000100:00100000:0.0:1783135403.920675:0:9765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.920702:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809074560 00000100:00100000:0.0:1783135403.920706:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809074560 00000100:00100000:0.0:1783135403.920725:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783135403.920730:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9765:x1869752809074560:12345-0@lo:502: 00000100:00100000:0.0:1783135403.920783:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:9765:x1869752809074560:12345-0@lo:502: Request processed in 52us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.920789:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783135403.920828:0:9765:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672de3180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.920840:0:9765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9765:1869752809074560:0@lo:502: 00000020:01000000:0.0:1783135403.920856:0:9765:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135403.920860:0:9765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135403.920862:0:9765:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783135403.920865:0:9765:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1783135403.921245:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1783135403.921278:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783135403.921288:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.921299:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135403.921311:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783135403.921314:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac6743ed800 from 39 10000000:01000000:1.0:1783135403.921323:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135403.921369:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.921379:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.921388:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135403.921401:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543839180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074688:0@lo:101: 00000100:00100000:1.0:1783135403.921437:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.921468:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.921904:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809074688 00000100:00100000:0.0:1783135403.921912:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809074688 00000100:00100000:0.0:1783135403.921947:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783135403.921956:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809074688:12345-0@lo:101: 00010000:00010000:0.0:1783135403.921967:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135403.921982:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edf8dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf8d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.922019:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edf8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf8d5 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.922030:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edf8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf8d5 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.922039:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65de00, rc 0) 00000100:00100000:0.0:1783135403.922082:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809074688:12345-0@lo:101: Request processed in 127us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.922112:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783135403.922154:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543839180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074688:0@lo:101: 00010000:00010000:0.0:1783135403.922167:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.922176:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135403.922233:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074816:0@lo:501: 00000100:00100000:0.0:1783135403.922261:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.922276:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43e480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.922288:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809074816 00000100:00100000:0.0:1783135403.922291:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809074816 00000100:00100000:0.0:1783135403.922312:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783135403.922318:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809074816:12345-0@lo:501: 00000100:00100000:0.0:1783135403.922447:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809074816:12345-0@lo:501: Request processed in 128us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.922454:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783135403.922484:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074816:0@lo:501: 00000100:00100000:0.0:1783135403.922512:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074944:0@lo:503: 00000100:00100000:0.0:1783135403.922550:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.922563:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43e480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.922573:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809074944 00000100:00100000:0.0:1783135403.922576:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809074944 00000100:00100000:0.0:1783135403.922596:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783135403.922601:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809074944:12345-0@lo:503: 00000100:00100000:0.0:1783135403.922675:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809074944:12345-0@lo:503: Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.922681:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783135403.922721:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809074944:0@lo:503: 00000100:00100000:0.0:1783135403.922900:0:9766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9766:1869752809075072:0@lo:502: 00000100:00100000:0.0:1783135403.922934:0:9766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.922952:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809075072 00000100:00100000:0.0:1783135403.922955:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809075072 00000100:00100000:0.0:1783135403.922977:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783135403.922982:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:9766:x1869752809075072:12345-0@lo:502: 00000100:00100000:0.0:1783135403.923058:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:9766:x1869752809075072:12345-0@lo:502: Request processed in 75us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.923065:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783135403.923117:0:9766:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.923129:0:9766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9766:1869752809075072:0@lo:502: 00000100:00100000:0.0:1783135403.923168:0:9766:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9766:1869752809075200:0@lo:502: 00000100:00100000:0.0:1783135403.923199:0:9766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.923216:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809075200 00000100:00100000:0.0:1783135403.923220:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809075200 00000100:00100000:0.0:1783135403.923239:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783135403.923244:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:9766:x1869752809075200:12345-0@lo:502: 00000100:00100000:0.0:1783135403.923301:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:9766:x1869752809075200:12345-0@lo:502: Request processed in 56us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.923308:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783135403.923336:0:9766:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.923351:0:9766:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9766:1869752809075200:0@lo:502: 00000040:00080000:0.0:1783135403.923369:0:9766:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1783135403.923417:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1783135403.923444:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783135403.923451:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.923460:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135403.923468:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783135403.923470:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac6743ed800 from 6 10000000:01000000:0.0:1783135403.923472:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135403.923495:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.923504:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.923513:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135403.923525:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809075328:0@lo:101: 00000100:00100000:0.0:1783135403.923550:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.923562:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672de3540 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.923574:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809075328 00000100:00100000:0.0:1783135403.923576:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809075328 00000100:00100000:0.0:1783135403.923596:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783135403.923602:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809075328:12345-0@lo:101: 00010000:00010000:0.0:1783135403.923610:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135403.923628:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65c000/0xf7de4ef628edf8ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf8e3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.923647:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65c000/0xf7de4ef628edf8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf8e3 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.923656:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65c000/0xf7de4ef628edf8ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf8e3 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.923664:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c000, rc 0) 00000100:00100000:0.0:1783135403.923690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809075328:12345-0@lo:101: Request processed in 88us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.923696:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783135403.923724:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809075328:0@lo:101: 00010000:00010000:0.0:1783135403.923735:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.923743:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135403.923787:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809075456:0@lo:256: 00000100:00100000:0.0:1783135403.923815:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.923827:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.923838:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809075456 00000100:00100000:0.0:1783135403.923841:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809075456 00000100:00100000:0.0:1783135403.923859:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783135403.923864:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809075456:12345-0@lo:256: 20000000:01000000:0.0:1783135403.923875:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783135403.923892:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783135403.923898:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1783135403.923964:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809075456:12345-0@lo:256: Request processed in 99us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.923971:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783135403.924012:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809075456:0@lo:256: 10000000:01000000:0.0:1783135403.924052:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135403.924057:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.924064:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135403.924071:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783135403.924073:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1783135403.924075:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783135403.924119:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.924127:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.924134:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135403.924145:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809075584:0@lo:101: 00000100:00100000:0.0:1783135403.924169:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.924182:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.924193:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809075584 00000100:00100000:0.0:1783135403.924195:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809075584 00000100:00100000:0.0:1783135403.924215:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783135403.924227:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809075584:12345-0@lo:101: 00010000:00010000:0.0:1783135403.924234:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135403.924242:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf8f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf8f1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.924256:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf8f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf8f1 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.924263:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf8f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf8f1 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.924268:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65da00, rc 0) 00000100:00100000:0.0:1783135403.924296:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809075584:12345-0@lo:101: Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.924302:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783135403.924330:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809075584:0@lo:101: 00010000:00010000:0.0:1783135403.924339:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.924346:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135403.924388:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809075712:0@lo:501: 00000100:00100000:0.0:1783135403.924412:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.924423:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.924433:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809075712 00000100:00100000:0.0:1783135403.924436:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809075712 00000100:00100000:0.0:1783135403.924454:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783135403.924459:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809075712:12345-0@lo:501: 00000100:00100000:0.0:1783135403.924558:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809075712:12345-0@lo:501: Request processed in 97us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.924564:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783135403.924589:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809075712:0@lo:501: 00000100:00100000:0.0:1783135403.924610:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809075840:0@lo:503: 00000100:00100000:0.0:1783135403.924641:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.924653:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b587840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.924663:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809075840 00000100:00100000:0.0:1783135403.924666:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809075840 00000100:00100000:0.0:1783135403.924683:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783135403.924688:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809075840:12345-0@lo:503: 00000100:00100000:0.0:1783135403.924752:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809075840:12345-0@lo:503: Request processed in 63us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.924757:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783135403.924790:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809075840:0@lo:503: 00000100:00100000:1.0:1783135403.925515:0:9767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9767:1869752809075968:0@lo:502: 00000100:00100000:1.0:1783135403.925560:0:9767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.925585:0:9767:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135403.928878:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809075968 00000100:00100000:1.0:1783135403.928895:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809075968 00000100:00100000:1.0:1783135403.928969:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783135403.928980:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:9767:x1869752809075968:12345-0@lo:502: 00000100:00100000:1.0:1783135403.929223:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:9767:x1869752809075968:12345-0@lo:502: Request processed in 243us (3661us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.929231:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783135403.929303:0:9767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9767:1869752809075968:0@lo:502: 00000020:01000000:1.0:1783135403.929339:0:9767:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783135403.929349:0:9767:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1783135403.929724:0:9767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135403.929728:0:9767:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783135403.929742:0:9767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783135403.929748:0:9767:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:1.0:1783135403.929770:0:9767:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1783135403.929773:0:9767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135403.929789:0:9767:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8ac67e2d0000) 00000020:00000080:1.0:1783135403.929816:0:9767:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1783135403.929822:0:9767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783135403.929920:0:9767:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1783135403.929928:0:9767:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783135403.929934:0:9767:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628edf906 00010000:00080000:1.0:1783135403.929998:0:9767:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac54392b800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1783135403.931490:0:9767:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1783135403.931652:0:9767:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783135403.931669:0:9767:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1783135403.931876:0:9767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135403.932022:0:9767:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135403.932256:0:9767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783135403.932351:0:9767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1783135403.941837:0:9768:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135403.941847:0:9768:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783135403.943532:0:9767:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783135403.943559:0:9767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783135403.943602:0:9767:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783135403.943631:0:9767:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628edf90d 00000100:00080000:1.0:1783135403.943643:0:9767:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135403.943649:0:9767:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ac54392b800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135403.943686:0:9767:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac54383b480 x1869752809076096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135403.943714:0:9767:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783135403.943770:0:9767:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135403.943774:0:9767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135403.943775:0:9767:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783135403.943785:0:9767:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135403.943789:0:9767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135403.943791:0:9767:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783135403.943794:0:9767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783135403.943796:0:9767:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783135403.943826:0:9767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9767:1869752809076224:0@lo:502: 00000100:00100000:1.0:1783135403.943903:0:9767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.943938:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809076224 00000100:00100000:1.0:1783135403.943944:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809076224 00000100:00100000:1.0:1783135403.943995:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783135403.944006:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:9767:x1869752809076224:12345-0@lo:502: 00000100:00100000:1.0:1783135403.944150:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:9767:x1869752809076224:12345-0@lo:502: Request processed in 145us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.944158:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783135403.944217:0:9767:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135403.944240:0:9767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9767:1869752809076224:0@lo:502: 00000020:01000000:1.0:1783135403.944267:0:9767:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135403.944271:0:9767:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135403.944272:0:9767:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783135403.944276:0:9767:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1783135403.944328:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1783135403.944351:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783135403.946312:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.946329:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135403.946341:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783135403.946352:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac64382e000 from 39 10000000:01000000:1.0:1783135403.947479:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135403.947532:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.947557:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.947570:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135403.947594:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809076352:0@lo:101: 00000100:00100000:1.0:1783135403.947659:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.947707:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072000 going to sleep for 11 seconds 00000100:00100000:2.0:1783135403.947816:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809076096:0@lo:8: 00000100:00100000:2.0:1783135403.947867:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135403.947918:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809076096 00000100:00100000:2.0:1783135403.947927:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809076096 00000100:00100000:2.0:1783135403.947993:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135403.948001:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869752809076096:12345-0@lo:8: 00010000:00080000:2.0:1783135403.948043:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:2.0:1783135403.948076:0:8435:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628edf91b 00002000:00100000:2.0:1783135403.948105:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8ac67c6fb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1783135403.948109:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1783135403.948114:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1783135403.948179:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783135403.948599:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1783135403.948648:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6fa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135403.948731:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869752809076096:12345-0@lo:8: Request processed in 728us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135403.948746:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135403.949692:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809076352 00000100:00100000:0.0:1783135403.949702:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809076352 00000100:00100000:0.0:1783135403.949762:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783135403.949774:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809076352:12345-0@lo:101: 00010000:00010000:0.0:1783135403.949788:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135403.949806:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65ce00/0xf7de4ef628edf922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf914 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.949837:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65ce00/0xf7de4ef628edf922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf914 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.949848:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65ce00/0xf7de4ef628edf922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf914 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135403.949866:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65ce00, rc 0) 00000100:00100000:0.0:1783135403.949916:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809076352:12345-0@lo:101: Request processed in 145us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.949923:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00010000:00080000:1.0:1783135403.950046:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54383b480 x1869752809076096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135403.950058:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135403.950068:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1783135403.950076:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783135403.950082:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783135403.950113:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac54392b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783135403.950132:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783135403.950138:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809076096:0@lo:8: 00000100:00100000:1.0:1783135403.950179:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809076352:0@lo:101: 00010000:00010000:1.0:1783135403.950196:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135403.950207:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135403.950287:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809076480:0@lo:501: 00000100:00100000:1.0:1783135403.950320:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.950348:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135403.950495:0:9769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9769:1869752809076608:0@lo:700: 00000100:00100000:0.0:1783135403.950526:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135403.950560:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809076480 00000100:00100000:2.0:1783135403.950568:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809076480 00000100:00100000:2.0:1783135403.950608:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1783135403.950617:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809076480:12345-0@lo:501: 00000100:00100000:2.0:1783135403.950777:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809076480:12345-0@lo:501: Request processed in 162us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135403.950785:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783135403.954398:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809076480:0@lo:501: 00000100:00100000:3.0:1783135403.954472:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809076736:0@lo:503: 00000100:00100000:3.0:1783135403.954567:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.954802:0:9769:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b587840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135403.954980:0:8608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809076608 00000100:00100000:1.0:1783135403.954997:0:8608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809076608 00000100:00100000:1.0:1783135403.955073:0:8608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135403.955083:0:8608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9769:x1869752809076608:12345-0@lo:700: 00000100:00100000:1.0:1783135403.955150:0:8608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8608:1869752809076864:0@lo:700: 00000100:00100000:1.0:1783135403.955186:0:8608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135403.955205:0:8608:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135403.955234:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809076864 00000100:00100000:1.0:1783135403.955237:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809076864 00000100:00100000:1.0:1783135403.955263:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135403.955269:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8608:x1869752809076864:12345-0@lo:700: 00000004:00080000:1.0:1783135403.955490:0:9768:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783135403.955747:0:9768:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 307748658523ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783135403.955760:0:9768:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:0.0:1783135403.956813:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135403.958576:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135403.959367:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809076736 00000100:00100000:2.0:1783135403.959443:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809076736 00000100:00100000:2.0:1783135403.959782:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783135403.959793:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809076736:12345-0@lo:503: 00000100:00100000:2.0:1783135403.959977:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809076736:12345-0@lo:503: Request processed in 175us (5399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135403.960163:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783135403.962899:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809076736:0@lo:503: 00000100:00100000:3.0:1783135403.969003:0:9771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9771:1869752809076992:0@lo:502: 00000100:00100000:3.0:1783135403.969123:0:9771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.969163:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809076992 00000100:00100000:3.0:1783135403.969170:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809076992 00000100:00100000:3.0:1783135403.969219:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783135403.969229:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:9771:x1869752809076992:12345-0@lo:502: 00000100:00100000:3.0:1783135403.969350:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:9771:x1869752809076992:12345-0@lo:502: Request processed in 121us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.969359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783135403.969417:0:9771:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135403.969457:0:9771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9771:1869752809076992:0@lo:502: 00000100:00100000:3.0:1783135403.969504:0:9771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9771:1869752809077120:0@lo:502: 00000100:00100000:3.0:1783135403.969538:0:9771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135403.972948:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809077120 00000100:00100000:2.0:1783135403.972963:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809077120 00000100:00100000:3.0:1783135403.972965:0:9771:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135403.975186:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1783135403.975201:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:9771:x1869752809077120:12345-0@lo:502: 00000100:00100000:2.0:1783135403.975384:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:9771:x1869752809077120:12345-0@lo:502: Request processed in 185us (5843us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135403.975392:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000004:00080000:2.0:1783135403.984958:0:7453:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1783135403.991762:0:9771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9771:1869752809077120:0@lo:502: 00000040:00080000:3.0:1783135403.991822:0:9771:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1783135403.992924:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1783135403.992954:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135403.992980:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135403.993023:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135403.993036:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783135403.993038:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac64382e000 from 6 10000000:01000000:2.0:1783135403.993042:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135403.993103:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135403.993112:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135403.993125:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135403.993153:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543766a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809077248:0@lo:101: 00000100:00100000:2.0:1783135403.993235:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135403.993280:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6528ecc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135403.993288:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809077248 00000100:00100000:3.0:1783135403.993296:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809077248 00000100:00100000:3.0:1783135403.993350:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783135403.993360:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809077248:12345-0@lo:101: 00010000:00010000:3.0:1783135403.993376:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135403.993391:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c526200/0xf7de4ef628edf930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf929 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135403.993415:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c526200/0xf7de4ef628edf930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf929 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135403.993426:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c526200/0xf7de4ef628edf930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf929 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135403.993435:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526200, rc 0) 00000100:00100000:3.0:1783135403.993478:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809077248:12345-0@lo:101: Request processed in 119us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.993485:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783135403.993960:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543766a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809077248:0@lo:101: 00010000:00010000:3.0:1783135403.993976:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135403.994001:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135403.994737:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809077376:0@lo:256: 00000100:00100000:3.0:1783135403.994793:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.994825:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135403.994879:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809077376 00000100:00100000:3.0:1783135403.994889:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809077376 00000100:00100000:3.0:1783135403.994922:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783135403.994929:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809077376:12345-0@lo:256: 20000000:01000000:3.0:1783135403.994946:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783135403.994962:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783135403.994965:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1783135403.995790:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809077376:12345-0@lo:256: Request processed in 857us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.995801:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 40000000:02000000:3.0:1783135403.995855:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1783135404.002406:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809077376:0@lo:256: 10000000:01000000:2.0:1783135404.002503:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135404.002516:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.002528:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135404.002537:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783135404.002541:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1783135404.002565:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783135404.002607:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.002617:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.002627:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135404.002646:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809077504:0@lo:101: 00000100:00100000:2.0:1783135404.002712:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135404.002755:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6528ec840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135404.002778:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809077504 00000100:00100000:2.0:1783135404.002785:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809077504 00000100:00100000:2.0:1783135404.002838:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783135404.002846:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809077504:12345-0@lo:101: 00010000:00010000:2.0:1783135404.002861:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135404.002874:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac650989800/0xf7de4ef628edf93e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf937 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.002897:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650989800/0xf7de4ef628edf93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf937 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.002906:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac650989800/0xf7de4ef628edf93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf937 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.002916:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989800, rc 0) 00000100:00100000:2.0:1783135404.002951:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809077504:12345-0@lo:101: Request processed in 105us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.002967:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1783135404.003025:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809077504:0@lo:101: 00010000:00010000:2.0:1783135404.003038:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.003047:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135404.003126:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809077632:0@lo:501: 00000100:00100000:2.0:1783135404.003151:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135404.003163:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6528ec840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135404.003175:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809077632 00000100:00100000:2.0:1783135404.003178:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809077632 00000100:00100000:2.0:1783135404.003200:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783135404.003206:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809077632:12345-0@lo:501: 00000100:00100000:2.0:1783135404.003317:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809077632:12345-0@lo:501: Request processed in 111us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.003325:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783135404.003353:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809077632:0@lo:501: 00000100:00100000:2.0:1783135404.003378:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809077760:0@lo:503: 00000100:00100000:2.0:1783135404.003416:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135404.003429:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6528ec840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135404.003439:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809077760 00000100:00100000:2.0:1783135404.003443:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809077760 00000100:00100000:2.0:1783135404.003462:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783135404.003467:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809077760:12345-0@lo:503: 00000100:00100000:2.0:1783135404.003550:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809077760:12345-0@lo:503: Request processed in 82us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.003556:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783135404.003598:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809077760:0@lo:503: 00000100:00100000:2.0:1783135404.007311:0:9776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9776:1869752809077888:0@lo:502: 00000100:00100000:2.0:1783135404.008057:0:9776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135404.008142:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809077888 00000100:00100000:2.0:1783135404.008150:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809077888 00000100:00100000:2.0:1783135404.008197:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783135404.008206:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:9776:x1869752809077888:12345-0@lo:502: 00000100:00100000:2.0:1783135404.008476:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:9776:x1869752809077888:12345-0@lo:502: Request processed in 152us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.008486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783135404.009649:0:9776:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6528ecb40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135404.009702:0:9776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9776:1869752809077888:0@lo:502: 00000020:01000000:2.0:1783135404.009745:0:9776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783135404.009754:0:9776:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783135404.009762:0:9776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135404.009765:0:9776:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783135404.009771:0:9776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783135404.009777:0:9776:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:2.0:1783135404.009805:0:9776:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783135404.009807:0:9776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135404.009822:0:9776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ac543598000) 00000020:00000080:2.0:1783135404.009847:0:9776:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1783135404.009853:0:9776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783135404.009955:0:9776:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783135404.009969:0:9776:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783135404.009999:0:9776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628edf94c 00010000:00080000:2.0:1783135404.010037:0:9776:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac5439cf800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:2.0:1783135404.010303:0:9776:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1783135404.010459:0:9776:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1783135404.010476:0:9776:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783135404.013856:0:9776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135404.016493:0:9776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135404.017324:0:9776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1783135404.017446:0:9776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:2.0:1783135404.023686:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543839500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8608:x1869752809076864:12345-0@lo:700: Request processed in 68407us (68488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.023702:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783135404.023856:0:8608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54383b480 x1869752809076864/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783135419 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135404.023874:0:8608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383b480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8608:1869752809076864:0@lo:700: 40000000:02000000:1.0:1783135404.023890:0:8608:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:2.0:1783135404.031465:0:9777:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135404.031476:0:9777:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783135404.035123:0:9776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135404.035143:0:9776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783135404.035196:0:9776:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783135404.035229:0:9776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628edf953 00000100:00080000:2.0:1783135404.035242:0:9776:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135404.035249:0:9776:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ac5439cf800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135404.035295:0:9776:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac543765500 x1869752809078016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135404.035326:0:9776:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783135404.035382:0:9776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135404.035387:0:9776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135404.035389:0:9776:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783135404.035393:0:9776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135404.035397:0:9776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135404.035399:0:9776:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135404.035417:0:9776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135404.035419:0:9776:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783135404.035451:0:9776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543764380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9776:1869752809078144:0@lo:502: 00000100:00100000:2.0:1783135404.035563:0:9776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135404.035605:0:9776:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac659b8a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135404.035632:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809078144 00000100:00100000:2.0:1783135404.035638:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809078144 00000100:00100000:2.0:1783135404.035679:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783135404.035688:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:9776:x1869752809078144:12345-0@lo:502: 00000100:00100000:2.0:1783135404.035812:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:9776:x1869752809078144:12345-0@lo:502: Request processed in 125us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.035820:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783135404.035876:0:9776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543764380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:9776:1869752809078144:0@lo:502: 00000020:01000000:2.0:1783135404.035901:0:9776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135404.035905:0:9776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135404.035907:0:9776:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783135404.035910:0:9776:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1783135404.036038:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1783135404.036059:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783135404.036070:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.036081:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135404.036120:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783135404.036123:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ac66b5899c0 from 1 10000000:01000000:2.0:1783135404.036127:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783135404.036153:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.036169:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.036181:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135404.036195:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543764380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809078272:0@lo:101: 00000100:00100000:2.0:1783135404.036226:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135404.036242:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac659b8a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135404.036256:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809078272 00000100:00100000:2.0:1783135404.036260:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809078272 00000100:00100000:2.0:1783135404.036284:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783135404.036291:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809078272:12345-0@lo:101: 00010000:00010000:2.0:1783135404.036301:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135404.036314:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf95a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.036337:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf95a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.036349:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf95a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.036358:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988400, rc 0) 00000100:00100000:2.0:1783135404.036388:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809078272:12345-0@lo:101: Request processed in 98us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.036394:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783135404.036424:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543764380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809078272:0@lo:101: 00010000:00010000:2.0:1783135404.036444:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.036454:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135404.036502:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543764380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809078400:0@lo:501: 00000100:00100000:2.0:1783135404.036527:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135404.036539:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac659b8a240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135404.036550:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809078400 00000100:00100000:2.0:1783135404.036554:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809078400 00000100:00100000:2.0:1783135404.036576:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783135404.036583:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809078400:12345-0@lo:501: 00000100:00100000:2.0:1783135404.036646:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809078400:12345-0@lo:501: Request processed in 63us (118us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135404.036653:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1783135404.036686:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543764380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809078400:0@lo:501: 10000000:01000000:2.0:1783135404.036704:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783135404.036709:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135404.036716:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135404.037704:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809078016:0@lo:8: 00000100:00100000:1.0:1783135404.037753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135404.038631:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809078016 00000100:00100000:0.0:1783135404.038642:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809078016 00000100:00100000:0.0:1783135404.038682:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135404.038689:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1869752809078016:12345-0@lo:8: 00010000:00080000:0.0:1783135404.038723:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:0.0:1783135404.038755:0:8437:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628edf968 00002000:00100000:0.0:1783135404.038770:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ac67c62f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783135404.038774:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783135404.038776:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783135404.042832:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783135404.042879:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8ac5439c8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135404.042980:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1869752809078016:12345-0@lo:8: Request processed in 4288us (5224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.043010:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783135404.043167:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543765500 x1869752809078016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135404.043185:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135404.043195:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783135404.043204:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783135404.043209:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783135404.043212:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac5439cf800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783135404.043226:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783135404.043230:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809078016:0@lo:8: 00000001:00100000:1.0:1783135404.043796:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1783135404.043874:0:8608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9769:x1869752809076608:12345-0@lo:700: Request processed in 88791us (93345us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135404.043885:0:8608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783135404.043908:0:9769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac541d9b800 x1869752809076608/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783135419 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135404.043920:0:9769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9769:1869752809076608:0@lo:700: 00000004:00080000:2.0:1783135404.044139:0:9777:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783135404.044195:0:9777:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307837106509ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783135404.044201:0:9777:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1783135404.046191:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1783135404.057226:0:9778:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783135404.057262:0:9778:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9778:1869752809078656:0@lo:7: 00000100:00100000:3.0:1783135404.057343:0:9778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135404.057377:0:9778:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646dd8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135404.057457:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135404.057472:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809078528:0@lo:13: 00000100:00100000:0.0:1783135404.057509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135404.057772:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809078528 00000100:00100000:3.0:1783135404.057780:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809078528 00000100:00100000:3.0:1783135404.057853:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135404.057862:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809078528:12345-0@lo:13: 00002000:00000024:3.0:1783135404.057891:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1783135404.057935:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809078528:12345-0@lo:13: Request processed in 74us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135404.057943:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1783135404.058187:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783135404.058224:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac66b59aa00 x1869752809078528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135404.058244:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809078528:0@lo:13: 00000100:00100000:0.0:1783135404.059197:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809078656 00000100:00100000:0.0:1783135404.059220:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809078656 00000100:00100000:0.0:1783135404.059264:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135404.059272:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9778:x1869752809078656:12345-0@lo:7: 00000004:00080000:3.0:1783135404.066753:0:9769:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783135404.066785:0:9769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9769:1869752809078912:0@lo:7: 00000100:00100000:3.0:1783135404.066879:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135404.066923:0:9769:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646dd8300 going to sleep for 11 seconds 00000100:00100000:3.0:1783135404.067125:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809078784:0@lo:13: 00000100:00100000:3.0:1783135404.067154:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135404.067202:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809078784 00000100:00100000:3.0:1783135404.067209:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809078784 00000100:00100000:3.0:1783135404.067257:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135404.067265:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809078784:12345-0@lo:13: 00002000:00000024:3.0:1783135404.067290:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1783135404.067334:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809078784:12345-0@lo:13: Request processed in 68us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135404.067341:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783135404.067387:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c651f80 x1869752809078784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135404.067408:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809078784:0@lo:13: 00000100:00100000:2.0:1783135404.068215:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809078912 00000100:00100000:2.0:1783135404.068226:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809078912 00000100:00100000:2.0:1783135404.068274:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135404.068282:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9769:x1869752809078912:12345-0@lo:7: 00002000:00080000:0.0:1783135404.071594:0:8620:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1783135404.071603:0:8620:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1783135404.071721:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9778:x1869752809078656:12345-0@lo:7: Request processed in 12444us (14374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135404.071734:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1783135404.082377:0:9778:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac66b598a80 x1869752809078656/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783135420 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135404.082398:0:9778:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9778:1869752809078656:0@lo:7: 00000004:00080000:3.0:1783135404.082417:0:9778:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783135404.082468:0:9778:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9778:1869752809079040:0@lo:5: 00000100:00100000:3.0:1783135404.082535:0:9778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135404.082709:0:9778:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646dd8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135404.082731:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809079040 00000100:00100000:3.0:1783135404.082737:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809079040 00000100:00100000:3.0:1783135404.082781:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135404.082791:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9778:x1869752809079040:12345-0@lo:5: 00002000:00080000:3.0:1783135404.082830:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1783135404.082834:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:2.0:1783135404.091315:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1783135404.091328:0:8438:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783135404.091427:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9769:x1869752809078912:12345-0@lo:7: Request processed in 23140us (24543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.091440:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1783135404.091500:0:9769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c651c00 x1869752809078912/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783135420 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135404.091517:0:9769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9769:1869752809078912:0@lo:7: 00000004:00080000:2.0:1783135404.091532:0:9769:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783135404.093895:0:9769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543764380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9769:1869752809079168:0@lo:5: 00000100:00100000:2.0:1783135404.093978:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1783135404.095892:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1783135404.095910:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783135404.096054:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9778:x1869752809079040:12345-0@lo:5: Request processed in 13261us (13515us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783135404.096066:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135404.096119:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809079168 00000100:00100000:3.0:1783135404.096127:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809079168 00000100:00100000:3.0:1783135404.096169:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135404.096176:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9769:x1869752809079168:12345-0@lo:5: 00002000:00080000:3.0:1783135404.096209:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1783135404.098784:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9769:x1869752809079168:12345-0@lo:5: Request processed in 2597us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135404.098803:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783135404.098900:0:9778:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c651f80 x1869752809079040/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135420 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135404.098914:0:9778:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783135404.098922:0:9778:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9778:1869752809079040:0@lo:5: 00000004:00080000:3.0:1783135404.098939:0:9778:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783135404.100210:0:9778:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9778:1869752809079296:0@lo:700: 00000100:00100000:3.0:1783135404.100277:0:9778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135404.100306:0:9778:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646dd8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135404.100340:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809079296 00000100:00100000:3.0:1783135404.100347:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809079296 00000100:00100000:3.0:1783135404.100399:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135404.100408:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9778:x1869752809079296:12345-0@lo:700: 00000100:00100000:2.0:1783135404.101140:0:9769:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354b40 going to sleep for 11 seconds 00010000:00080000:2.0:1783135404.101169:0:9769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543764380 x1869752809079168/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135420 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135404.101184:0:9769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543764380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9769:1869752809079168:0@lo:5: 00000004:00080000:2.0:1783135404.101198:0:9769:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1783135404.101234:0:9769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543764380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9769:1869752809079424:0@lo:5: 00000100:00100000:2.0:1783135404.101274:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135404.101295:0:9769:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135404.101316:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809079424 00000100:00100000:2.0:1783135404.101321:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809079424 00000100:00100000:2.0:1783135404.101351:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135404.101358:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9769:x1869752809079424:12345-0@lo:5: 00002000:00080000:2.0:1783135404.101393:0:8620:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1783135404.109979:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9769:x1869752809079424:12345-0@lo:5: Request processed in 8614us (8697us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783135404.110004:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1783135404.110857:0:9769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543764380 x1869752809079424/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135420 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135404.110880:0:9769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543764380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9769:1869752809079424:0@lo:5: 00000004:00080000:3.0:1783135404.110896:0:9769:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783135404.110936:0:9769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9769:1869752809079552:0@lo:900: 00000100:00100000:3.0:1783135404.110977:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135404.111075:0:9769:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646dd80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135404.112212:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809079552 00000100:00100000:2.0:1783135404.112225:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809079552 00000100:00100000:2.0:1783135404.112284:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135404.112293:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9769:x1869752809079552:12345-0@lo:900: 00000100:00100000:2.0:1783135404.112368:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9769:x1869752809079552:12345-0@lo:900: Request processed in 76us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.112376:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783135404.127237:0:9769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c652d80 x1869752809079552/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783135420 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135404.127257:0:9769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9769:1869752809079552:0@lo:900: 00000001:00080000:2.0:1783135404.143204:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1783135404.143422:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9778:x1869752809079296:12345-0@lo:700: Request processed in 43008us (43139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135404.143436:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783135404.146246:0:9778:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c651f80 x1869752809079296/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783135420 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135404.146268:0:9778:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9778:1869752809079296:0@lo:700: 00000004:02000040:3.0:1783135404.151848:0:9778:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1783135404.165978:0:9778:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9778:1869752809079680:0@lo:5: 00000100:00100000:0.0:1783135404.166112:0:9778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135404.166176:0:9778:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6738029c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135404.170773:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809079680 00000100:00100000:3.0:1783135404.170791:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809079680 00000100:00100000:3.0:1783135404.170866:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135404.170880:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9778:x1869752809079680:12345-0@lo:5: 00002000:00080000:2.0:1783135404.180607:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1783135404.180628:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1783135404.182245:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b598a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9778:x1869752809079680:12345-0@lo:5: Request processed in 11362us (16153us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783135404.182262:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1783135404.183234:0:9778:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac541d99c00 x1869752809079680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135420 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135404.183256:0:9778:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9778:1869752809079680:0@lo:5: 00000004:00080000:0.0:1783135404.183276:0:9778:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:2.0:1783135404.401134:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809079808:0@lo:41: 00000100:00100000:2.0:1783135404.401253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135404.401722:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809079936:0@lo:13: 00000100:00100000:2.0:1783135404.401763:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135404.401862:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809079936 00000100:00100000:3.0:1783135404.401871:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809079936 00000100:00100000:3.0:1783135404.401922:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135404.401934:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809079936:12345-0@lo:13: 00002000:00000024:3.0:1783135404.401970:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135404.402028:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809079936:12345-0@lo:13: Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135404.402035:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1783135404.402153:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c651880 x1869752809079936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135404.402176:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809079936:0@lo:13: 00000100:00100000:1.0:1783135404.406447:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809079808 00000100:00100000:1.0:1783135404.406462:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809079808 00000100:00100000:1.0:1783135404.406524:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783135404.406534:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809079808:12345-0@lo:41: 00000004:00000024:1.0:1783135404.406576:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1783135404.406669:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809079808:12345-0@lo:41: Request processed in 136us (5417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135404.406676:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783135404.406698:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135404.406712:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809080064:0@lo:13: 00000100:00100000:1.0:1783135404.406752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135404.406838:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809079808:0@lo:41: 00000100:00100000:1.0:1783135404.406862:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809080064 00000100:00100000:1.0:1783135404.406866:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809080064 00000100:00100000:1.0:1783135404.406891:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135404.406898:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809080064:12345-0@lo:13: 00002000:00000024:1.0:1783135404.406914:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135404.406947:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809080064:12345-0@lo:13: Request processed in 50us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135404.406954:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1783135404.406996:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543838380 x1869752809080064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135404.407010:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809080064:0@lo:13: 00010000:00010000:0.0:1783135404.912175:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135405.941255:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135406.471682:0:9891:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783135406.958288:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135407.473543:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135407.473570:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809080192:0@lo:41: 00000100:00100000:1.0:1783135407.473640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135407.473744:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809080192 00000100:00100000:0.0:1783135407.473753:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809080192 00000100:00100000:0.0:1783135407.473806:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783135407.473816:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809080192:12345-0@lo:41: 00000004:00000024:0.0:1783135407.473848:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135407.473897:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809080192:12345-0@lo:41: Request processed in 83us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135407.473904:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783135407.473957:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809080192:0@lo:41: 00000020:00000004:3.0:1783135407.616703:0:9943:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135407.616963:0:9943:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783135407.982355:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783135408.613041:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1783135409.009439:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135409.518606:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135409.518638:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809080320:0@lo:13: 00000100:00100000:2.0:1783135409.518719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.518929:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809080704:0@lo:400: 00000100:00100000:2.0:1783135409.518958:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.518974:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809081216:0@lo:400: 00000100:00100000:2.0:1783135409.518996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.519014:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809081728:0@lo:400: 00000100:00100000:2.0:1783135409.519032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.519049:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783135409.519054:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809080832:0@lo:400: 00000100:00100000:2.0:1783135409.519075:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.519113:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809081344:0@lo:400: 00000100:00100000:2.0:1783135409.519136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.519157:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809081856:0@lo:400: 00000100:00100000:2.0:1783135409.519173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.519207:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809081216 00000100:00100000:2.0:1783135409.519215:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809081216 00000100:00100000:2.0:1783135409.519283:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809081728 00000100:00100000:2.0:1783135409.519286:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809081728 00000100:00100000:2.0:1783135409.519301:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809080832 00000100:00100000:2.0:1783135409.519303:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809080832 00000100:00100000:2.0:1783135409.519316:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135409.519325:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809081216:12345-0@lo:400: 00000100:00100000:2.0:1783135409.519384:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809081216:12345-0@lo:400: Request processed in 58us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.519391:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135409.519394:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809080448:0@lo:400: 00000100:00100000:2.0:1783135409.519408:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783135409.519415:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809081728:12345-0@lo:400: 00000100:00100000:1.0:1783135409.519440:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.519451:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809081728:12345-0@lo:400: Request processed in 35us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.519459:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783135409.519479:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783135409.519485:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809080960:0@lo:400: 00000100:00100000:2.0:1783135409.519488:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809080832:12345-0@lo:400: 00000100:00100000:1.0:1783135409.519524:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.519530:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809080832:12345-0@lo:400: Request processed in 43us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.519537:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783135409.519548:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809081472:0@lo:400: 00000100:00100000:2.0:1783135409.519567:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809081344 00000100:00100000:2.0:1783135409.519571:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809081344 00000100:00100000:1.0:1783135409.519576:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.519601:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809081856 00000100:00100000:1.0:1783135409.519601:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783135409.519607:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809081856 00000100:00100000:1.0:1783135409.519610:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809080576:0@lo:400: 00000100:00100000:2.0:1783135409.519626:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809081472 00000100:00100000:2.0:1783135409.519637:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809081472 00000100:00100000:1.0:1783135409.519637:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.519661:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135409.519668:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809081344:12345-0@lo:400: 00000100:00100000:1.0:1783135409.519672:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809081088:0@lo:400: 00000100:00100000:2.0:1783135409.519709:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809081344:12345-0@lo:400: Request processed in 41us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.519716:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135409.519727:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135409.519733:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809081856:12345-0@lo:400: 00000100:00100000:2.0:1783135409.519761:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809081856:12345-0@lo:400: Request processed in 28us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.519766:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135409.519776:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135409.519782:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809081472:12345-0@lo:400: 00000100:00100000:2.0:1783135409.519806:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809081472:12345-0@lo:400: Request processed in 24us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.519811:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135409.519828:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809080576 00000100:00100000:2.0:1783135409.519832:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809080576 00000100:00100000:2.0:1783135409.519853:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783135409.519859:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809080576:12345-0@lo:400: 00000100:00100000:2.0:1783135409.519900:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809080576:12345-0@lo:400: Request processed in 41us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.519906:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1783135409.519970:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543764e00 x1869752809080832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135409.519985:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809080832:0@lo:400: 00010000:00080000:2.0:1783135409.520009:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543766a00 x1869752809081344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135409.520020:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543766a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809081344:0@lo:400: 00010000:00080000:2.0:1783135409.520029:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543960e00 x1869752809081856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135409.520037:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1783135409.520051:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809081856:0@lo:400: 00010000:00080000:2.0:1783135409.520063:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543765500 x1869752809081216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135409.520070:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.520081:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809081216:0@lo:400: 00010000:00080000:2.0:1783135409.520120:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543963800 x1869752809081728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135409.520121:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809081600:0@lo:400: 00000100:00100000:2.0:1783135409.520136:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809081728:0@lo:400: 00000100:00100000:2.0:1783135409.520188:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809080704 00000100:00100000:2.0:1783135409.520192:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809080704 00000100:00100000:2.0:1783135409.520214:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809080960 00000100:00100000:2.0:1783135409.520219:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809080960 00000100:00100000:1.0:1783135409.520219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.520238:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135409.520246:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809080704:12345-0@lo:400: 00010000:00080000:1.0:1783135409.520252:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac643474700 x1869752809081472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135409.520264:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809081472:0@lo:400: 00000100:00100000:1.0:1783135409.520283:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809081984:0@lo:41: 00000100:00100000:2.0:1783135409.520291:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809080704:12345-0@lo:400: Request processed in 45us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.520297:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135409.520309:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783135409.520314:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809080960:12345-0@lo:400: 00000100:00100000:2.0:1783135409.520363:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809080960:12345-0@lo:400: Request processed in 48us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.520369:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783135409.520390:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809080448 00000100:00100000:2.0:1783135409.520394:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809080448 00000100:00100000:2.0:1783135409.520418:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1783135409.520423:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809080448:12345-0@lo:400: 00000100:00100000:2.0:1783135409.520450:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809080448:12345-0@lo:400: Request processed in 27us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.520454:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783135409.520465:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783135409.520503:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543764a80 x1869752809080576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135409.520506:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809081088 00000100:00100000:2.0:1783135409.520512:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809081088 00000100:00100000:1.0:1783135409.520518:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809080576:0@lo:400: 00000100:00100000:1.0:1783135409.520532:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809080448:0@lo:400: 00000100:00100000:2.0:1783135409.520539:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809081600 00000100:00100000:2.0:1783135409.520544:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809081600 00000100:00100000:1.0:1783135409.520545:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809080960:0@lo:400: 00000100:00100000:2.0:1783135409.520567:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783135409.520571:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135409.520576:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809081088:12345-0@lo:400: 00000100:00100000:1.0:1783135409.520579:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809082112:0@lo:13: 00000100:00100000:2.0:1783135409.520616:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809081088:12345-0@lo:400: Request processed in 41us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135409.520617:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135409.520626:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783135409.520640:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135409.520647:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809081600:12345-0@lo:400: 00010000:00080000:1.0:1783135409.520651:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543765880 x1869752809081088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135409.520676:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809081600:12345-0@lo:400: Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.520682:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135409.520705:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809080704:0@lo:400: 00000100:00100000:2.0:1783135409.520742:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809081984 00000100:00100000:2.0:1783135409.520751:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809081984 00000100:00100000:2.0:1783135409.520768:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783135409.520773:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809081984:12345-0@lo:41: 00000004:00000024:2.0:1783135409.520796:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783135409.520826:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809081984:12345-0@lo:41: Request processed in 52us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135409.520830:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809081088:0@lo:400: 00000100:00100000:2.0:1783135409.520835:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1783135409.520853:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543960a80 x1869752809081600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135409.520862:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809080320 00000100:00100000:1.0:1783135409.520864:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809081600:0@lo:400: 00000100:00100000:2.0:1783135409.520867:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809080320 00000100:00100000:1.0:1783135409.520904:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809081984:0@lo:41: 00000100:00100000:2.0:1783135409.520907:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809082112 00000100:00100000:2.0:1783135409.520910:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809082112 00000100:00100000:2.0:1783135409.520926:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135409.520933:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809080320:12345-0@lo:13: 00002000:00000024:2.0:1783135409.520952:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135409.520980:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809080320:12345-0@lo:13: Request processed in 48us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.520986:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135409.520996:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135409.521003:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809082112:12345-0@lo:13: 00002000:00000024:2.0:1783135409.521017:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135409.521054:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809082112:12345-0@lo:13: Request processed in 52us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135409.521060:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1783135409.521084:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac66b59aa00 x1869752809080320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135409.521114:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00010000:00080000:1.0:1783135409.521120:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543963800 x1869752809082112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135409.521129:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809080320:0@lo:13: 00000100:00100000:1.0:1783135409.521148:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543963800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809082112:0@lo:13: 00000100:00080000:0.0:1783135409.521361:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135409.521367:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135409.521368:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135409.521371:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135409.522159:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809082240:0@lo:13: 00000100:00100000:0.0:1783135409.522205:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135409.522527:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809082240 00000100:00100000:3.0:1783135409.522534:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809082240 00000100:00100000:3.0:1783135409.522578:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135409.522598:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809082240:12345-0@lo:13: 00002000:00000024:3.0:1783135409.522620:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135409.522661:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809082240:12345-0@lo:13: Request processed in 64us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135409.522668:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1783135409.522747:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c651500 x1869752809082240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135409.522763:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809082240:0@lo:13: 00000100:00100000:1.0:1783135409.522940:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809082368:0@lo:13: 00000100:00100000:1.0:1783135409.522971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135409.523115:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809082368 00000100:00100000:3.0:1783135409.523119:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809082368 00000100:00100000:3.0:1783135409.523149:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135409.523155:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809082368:12345-0@lo:13: 00002000:00000024:3.0:1783135409.523166:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135409.530682:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809082368:12345-0@lo:13: Request processed in 7514us (7695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135409.530700:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1783135409.530824:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543960e00 x1869752809082368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135409.530848:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543960e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809082368:0@lo:13: 00010000:00010000:3.0:1783135410.031223:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783135411.006668:0:10044:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135411.006936:0:10044:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783135411.054220:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135412.078767:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783135412.339160:0:10092:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783135412.339172:0:10092:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1783135412.591300:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809082496:0@lo:41: 00000100:00100000:2.0:1783135412.591381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135412.596740:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809082496 00000100:00100000:0.0:1783135412.596754:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809082496 00000100:00100000:0.0:1783135412.596821:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783135412.596842:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809082496:12345-0@lo:41: 00000004:00000024:0.0:1783135412.596939:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135412.597036:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809082496:12345-0@lo:41: Request processed in 195us (5655us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135412.597044:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783135412.597164:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809082496:0@lo:41: 00000100:00100000:0.0:1783135412.920027:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135412.926024:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785961088 00000100:00100000:2.0:1783135412.926040:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785961088 00000100:00100000:2.0:1783135412.926120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 182 00000100:00100000:2.0:1783135412.926131:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2397:x1869752785961088:12345-192.168.204.6@tcp:250: 00010000:00080000:2.0:1783135412.926161:0:6517:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from f84f745c-c4b5-4c40-8739-179c07c4e2ba@192.168.204.6@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:2.0:1783135412.926193:0:6517:0:(genops.c:1406:class_connect()) connect: client f84f745c-c4b5-4c40-8739-179c07c4e2ba, cookie 0xf7de4ef628edf96f 00000100:00080000:2.0:1783135412.926331:0:6517:0:(import.c:65:import_set_state_nolock()) ffff8ac5439cd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135412.926464:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+5:2397:x1869752785961088:12345-192.168.204.6@tcp:250: Request processed in 333us (6447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135412.926472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 182 00000100:00100000:0.0:1783135412.938957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135412.939180:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785961216 00000100:00100000:2.0:1783135412.939190:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785961216 00000100:00100000:2.0:1783135412.939285:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 183 00000100:00100000:2.0:1783135412.939295:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac641681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+5:6161:x1869752785961216:12345-192.168.204.6@tcp:101: 00010000:00010000:2.0:1783135412.939312:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135412.939330:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac650988200/0xf7de4ef628edf976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140a9f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135412.939360:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650988200/0xf7de4ef628edf976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140a9f expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135412.939370:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac650988200/0xf7de4ef628edf976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140a9f expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135412.939395:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988200, rc 0) 00000100:00100000:2.0:1783135412.939521:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac641681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+6:6161:x1869752785961216:12345-192.168.204.6@tcp:101: Request processed in 227us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135412.939528:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 183 00000100:00100000:1.0:1783135412.958196:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135412.962955:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785961344 00000100:00100000:2.0:1783135412.962974:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785961344 00000100:00100000:2.0:1783135412.963108:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 184 00000100:00100000:2.0:1783135412.963122:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+6:6161:x1869752785961344:12345-192.168.204.6@tcp:501: 00000100:00100000:2.0:1783135412.963284:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+6:6161:x1869752785961344:12345-192.168.204.6@tcp:501: Request processed in 165us (5208us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135412.963292:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 184 00000100:00100000:1.0:1783135412.972283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135412.972374:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785961472 00000100:00100000:2.0:1783135412.972386:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785961472 00000100:00100000:2.0:1783135412.972446:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 185 00000100:00100000:2.0:1783135412.972457:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+6:6161:x1869752785961472:12345-192.168.204.6@tcp:101: 00010000:00010000:2.0:1783135412.972487:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135412.972505:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf97d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140aa6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135412.972534:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140aa6 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135412.972545:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140aa6 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135412.972555:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989600, rc 0) 00000100:00100000:2.0:1783135412.972671:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+7:6161:x1869752785961472:12345-192.168.204.6@tcp:101: Request processed in 215us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135412.972679:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 185 00000100:00100000:1.0:1783135412.987356:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135412.987457:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785961600 00000100:00100000:2.0:1783135412.987469:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785961600 00000100:00100000:2.0:1783135412.987651:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 186 00000100:00100000:2.0:1783135412.987661:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+7:6161:x1869752785961600:12345-192.168.204.6@tcp:501: 00000100:00100000:2.0:1783135412.993207:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:6161:x1869752785961600:12345-192.168.204.6@tcp:501: Request processed in 5532us (5846us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135412.993224:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 186 00000100:00100000:1.0:1783135412.995884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135412.996637:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785961728 00000100:00100000:0.0:1783135412.996649:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785961728 00000100:00100000:0.0:1783135412.996732:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 187 00000100:00100000:0.0:1783135412.996743:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:6161:x1869752785961728:12345-192.168.204.6@tcp:503: 00000100:00100000:0.0:1783135412.996937:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:6161:x1869752785961728:12345-192.168.204.6@tcp:503: Request processed in 195us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135412.996945:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 187 00000100:00100000:1.0:1783135413.000255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135413.000575:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785961856 00000100:00100000:0.0:1783135413.000587:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785961856 00000100:00100000:0.0:1783135413.000860:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 188 00000100:00100000:0.0:1783135413.000870:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:6180:x1869752785961856:12345-192.168.204.6@tcp:502: 00000100:00100000:0.0:1783135413.001052:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:6180:x1869752785961856:12345-192.168.204.6@tcp:502: Request processed in 183us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135413.001061:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 188 00000100:00100000:3.0:1783135413.048204:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135413.048334:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785961984 00000100:00100000:2.0:1783135413.048353:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785961984 00000100:00100000:2.0:1783135413.048430:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 189 00000100:00100000:2.0:1783135413.048442:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:6180:x1869752785961984:12345-192.168.204.6@tcp:502: 00000100:00100000:2.0:1783135413.048634:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:6180:x1869752785961984:12345-192.168.204.6@tcp:502: Request processed in 183us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135413.048643:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 189 00000100:00100000:3.0:1783135413.062608:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135413.062780:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785962112 00000100:00100000:0.0:1783135413.062796:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785962112 00000100:00100000:0.0:1783135413.062893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 190 00000100:00100000:0.0:1783135413.062904:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:6161:x1869752785962112:12345-192.168.204.6@tcp:101: 00010000:00010000:0.0:1783135413.062922:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135413.062942:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65d000/0xf7de4ef628edf984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ad7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135413.062974:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65d000/0xf7de4ef628edf984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ad7 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135413.062988:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65d000/0xf7de4ef628edf984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ad7 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135413.062997:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d000, rc 0) 00000100:00100000:0.0:1783135413.063071:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6161:x1869752785962112:12345-192.168.204.6@tcp:101: Request processed in 169us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135413.063077:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 190 00000100:00100000:0.0:1783135413.074330:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135413.075161:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785962240 00000100:00100000:1.0:1783135413.075173:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785962240 00000100:00100000:1.0:1783135413.075229:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 191 00000100:00100000:1.0:1783135413.075240:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6161:x1869752785962240:12345-192.168.204.6@tcp:256: 20000000:01000000:1.0:1783135413.075268:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783135413.075299:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783135413.075304:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783135413.075308:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783135413.075311:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1783135413.075313:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1783135413.084939:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6161:x1869752785962240:12345-192.168.204.6@tcp:256: Request processed in 9687us (10605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135413.084967:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 191 00000100:00100000:3.0:1783135413.089241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135413.089437:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785962368 00000100:00100000:2.0:1783135413.089452:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785962368 00000100:00100000:2.0:1783135413.089529:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 192 00000100:00100000:2.0:1783135413.089542:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6161:x1869752785962368:12345-192.168.204.6@tcp:101: 00010000:00010000:2.0:1783135413.089564:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135413.089587:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf98b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ade expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135413.089633:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf98b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ade expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135413.089663:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf98b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ade expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135413.089675:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989000, rc 0) 00000100:00100000:2.0:1783135413.089954:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6161:x1869752785962368:12345-192.168.204.6@tcp:101: Request processed in 413us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135413.089963:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 192 00000100:00100000:1.0:1783135413.094950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135413.101233:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785962496 00000100:00100000:0.0:1783135413.101260:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785962496 00000100:00100000:2.0:1783135413.102208:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 193 00000100:00100000:2.0:1783135413.102223:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6161:x1869752785962496:12345-192.168.204.6@tcp:501: 00010000:00010000:0.0:1783135413.103743:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135413.103977:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6161:x1869752785962496:12345-192.168.204.6@tcp:501: Request processed in 1748us (9032us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135413.103992:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 193 00000100:00100000:3.0:1783135413.112383:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135413.113064:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785962624 00000100:00100000:2.0:1783135413.113079:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785962624 00000100:00100000:2.0:1783135413.113186:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 194 00000100:00100000:2.0:1783135413.113199:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6161:x1869752785962624:12345-192.168.204.6@tcp:503: 00000100:00100000:2.0:1783135413.114872:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6161:x1869752785962624:12345-192.168.204.6@tcp:503: Request processed in 1660us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135413.114898:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 194 00000100:00100000:2.0:1783135413.130781:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135413.131219:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785962752 00000100:00100000:0.0:1783135413.131233:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785962752 00000100:00100000:0.0:1783135413.133746:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 195 00000100:00100000:0.0:1783135413.133778:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6186:x1869752785962752:12345-192.168.204.6@tcp:502: 00000100:00100000:0.0:1783135413.134204:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6186:x1869752785962752:12345-192.168.204.6@tcp:502: Request processed in 438us (3437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135413.134214:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 195 00000100:00100000:0.0:1783135413.137491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135413.137612:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785962880 00000100:00100000:2.0:1783135413.137626:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785962880 00000100:00100000:2.0:1783135413.137796:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 196 00000100:00100000:2.0:1783135413.137821:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6186:x1869752785962880:12345-192.168.204.6@tcp:502: 00000100:00100000:2.0:1783135413.138294:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6186:x1869752785962880:12345-192.168.204.6@tcp:502: Request processed in 483us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135413.138304:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 196 00000100:00100000:2.0:1783135413.150625:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135413.150733:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135413.151080:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785963008 00000100:00100000:0.0:1783135413.151115:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785963008 00000100:00100000:2.0:1783135413.151232:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785963264 00000100:00100000:2.0:1783135413.151237:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785963264 00000100:00100000:2.0:1783135413.151267:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:2.0:1783135413.151276:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1869752785963008:12345-192.168.204.6@tcp:38: 00010000:00080000:2.0:1783135413.151315:0:6524:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp t0 exp 0000000000000000 cur 316 last 0 00000100:00100000:1.0:1783135413.151496:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:1.0:1783135413.151504:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1869752785963264:12345-192.168.204.6@tcp:38: 00010000:00080000:1.0:1783135413.151546:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:1.0:1783135413.151609:0:6523:0:(genops.c:1406:class_connect()) connect: client 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe, cookie 0xf7de4ef628edf992 00000004:00100000:1.0:1783135413.151645:0:6523:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783135413.152134:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8ac543928800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135413.152233:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2397:x1869752785963264:12345-192.168.204.6@tcp:38: Request processed in 726us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135413.152244:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000020:00000080:2.0:1783135413.153657:0:6524:0:(genops.c:1406:class_connect()) connect: client 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe, cookie 0xf7de4ef628edf999 00000004:00100000:2.0:1783135413.153696:0:6524:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783135413.154160:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6fc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135413.154258:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2397:x1869752785963008:12345-192.168.204.6@tcp:38: Request processed in 2980us (3646us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135413.154271:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00010000:00010000:0.0:1783135414.127445:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135414.167577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135414.167926:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785963392 00000100:00100000:3.0:1783135414.167943:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785963392 00000100:00100000:3.0:1783135414.168055:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:3.0:1783135414.168068:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:0:x1869752785963392:12345-192.168.204.6@tcp:41: 00000004:00000024:3.0:1783135414.168165:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783135414.168282:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:0:x1869752785963392:12345-192.168.204.6@tcp:41: Request processed in 216us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135414.168290:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00080000:2.0:1783135414.168440:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135414.168551:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135414.168720:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785963136 00000100:00100000:2.0:1783135414.168727:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785963136 00000100:00100000:2.0:1783135414.168779:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:2.0:1783135414.168786:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:0:x1869752785963136:12345-192.168.204.6@tcp:41: 00000004:00000024:2.0:1783135414.168824:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783135414.168872:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:0:x1869752785963136:12345-192.168.204.6@tcp:41: Request processed in 86us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.168879:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00080000:0.0:1783135414.169116:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135414.172355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135414.172405:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785963520 00000100:00100000:0.0:1783135414.172417:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785963520 00000100:00100000:0.0:1783135414.172489:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:0.0:1783135414.172502:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6161:x1869752785963520:12345-192.168.204.6@tcp:41: 00000004:00000024:0.0:1783135414.172874:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783135414.173018:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6161:x1869752785963520:12345-192.168.204.6@tcp:41: Request processed in 517us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135414.173027:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:1.0:1783135414.183602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135414.184135:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785963648 00000100:00100000:2.0:1783135414.184150:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785963648 00000100:00100000:2.0:1783135414.184228:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:2.0:1783135414.184241:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6161:x1869752785963648:12345-192.168.204.6@tcp:40: 00000100:00100000:2.0:1783135414.184368:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6161:x1869752785963648:12345-192.168.204.6@tcp:40: Request processed in 129us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.184377:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:2.0:1783135414.188213:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135414.188518:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785963776 00000100:00100000:0.0:1783135414.188532:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785963776 00000100:00100000:0.0:1783135414.188623:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:0.0:1783135414.188634:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1869752785963776:12345-192.168.204.6@tcp:8: 00010000:00080000:0.0:1783135414.188680:0:8620:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1783135414.188719:0:8620:0:(genops.c:1406:class_connect()) connect: client 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe, cookie 0xf7de4ef628edf9a0 00002000:00100000:0.0:1783135414.188736:0:8620:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe/ffff8ac67c629000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135414.188759:0:8620:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135414.189383:0:8620:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783135414.189429:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8ac67c62e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135414.189594:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2397:x1869752785963776:12345-192.168.204.6@tcp:8: Request processed in 960us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135414.189604:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:1.0:1783135414.191151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135414.191615:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785964032 00000100:00100000:2.0:1783135414.191629:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785964032 00000100:00100000:2.0:1783135414.191697:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 197 00000100:00100000:2.0:1783135414.191710:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2399:x1869752785964032:12345-192.168.204.6@tcp:400: 00000100:00100000:2.0:1783135414.191821:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2399:x1869752785964032:12345-192.168.204.6@tcp:400: Request processed in 112us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.191838:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 197 00000100:00100000:1.0:1783135414.192390:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135414.192958:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785963904 00000100:00100000:2.0:1783135414.192968:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785963904 00000100:00100000:2.0:1783135414.193015:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:2.0:1783135414.193023:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1869752785963904:12345-192.168.204.6@tcp:8: 00010000:00080000:2.0:1783135414.193066:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:2.0:1783135414.193416:0:8435:0:(genops.c:1406:class_connect()) connect: client 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe, cookie 0xf7de4ef628edf9a7 00002000:00100000:2.0:1783135414.193434:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe/ffff8ac67c5e9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783135414.193459:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783135414.193717:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783135414.193763:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8ac67c5ef800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135414.193858:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2397:x1869752785963904:12345-192.168.204.6@tcp:8: Request processed in 833us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.193875:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:2.0:1783135414.196485:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135414.197190:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785964160 00000100:00100000:3.0:1783135414.197202:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785964160 00000100:00100000:3.0:1783135414.197278:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:3.0:1783135414.197291:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6161:x1869752785964160:12345-192.168.204.6@tcp:900: 00000100:00100000:3.0:1783135414.197399:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6161:x1869752785964160:12345-192.168.204.6@tcp:900: Request processed in 111us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135414.197408:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:3.0:1783135414.206557:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135414.207126:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785964288 00000100:00100000:2.0:1783135414.207140:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785964288 00000100:00100000:2.0:1783135414.207226:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:2.0:1783135414.207238:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6161:x1869752785964288:12345-192.168.204.6@tcp:33: 00000004:00080000:0.0:1783135414.235238:0:6525:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27883us 00000004:00200000:2.0:1783135414.269396:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783135414.269568:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6161:x1869752785964288:12345-192.168.204.6@tcp:33: Request processed in 62317us (63011us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.269579:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:0.0:1783135414.499705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135414.509547:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785964416 00000100:00100000:2.0:1783135414.509572:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785964416 00000100:00100000:2.0:1783135414.509766:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:2.0:1783135414.509780:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6204:x1869752785964416:12345-192.168.204.6@tcp:101: 00010000:00010000:2.0:1783135414.510504:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135414.510959:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628edf9ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140b0f expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135414.511070:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edf9b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135414.511136:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edf9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135414.511158:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edf9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135414.511223:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135414.511241:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135414.511263:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edf9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135414.511295:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628edf9ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b0f expref: 8 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135414.511317:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edf9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b0f expref: 7 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135414.511326:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac672e7a900) 00010000:00010000:2.0:1783135414.511329:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135414.511333:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e000, rc 0) 00000100:00100000:2.0:1783135414.511410:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:6204:x1869752785964416:12345-192.168.204.6@tcp:101: Request processed in 1632us (11722us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.511420:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:3.0:1783135414.638491:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809082624:0@lo:13: 00000100:00100000:0.0:1783135414.638640:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135414.638668:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809082752:0@lo:13: 00000100:00100000:3.0:1783135414.638691:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.638811:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809082624 00000100:00100000:2.0:1783135414.638821:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809082624 00000100:00100000:0.0:1783135414.642845:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783135414.649166:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135414.649410:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809082880:0@lo:400: 00000100:00100000:0.0:1783135414.649488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.650035:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809082752 00000100:00100000:2.0:1783135414.650045:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809082752 00000100:00100000:2.0:1783135414.650127:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135414.650139:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809082624:12345-0@lo:13: 00002000:00000024:2.0:1783135414.650169:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135414.650225:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809082624:12345-0@lo:13: Request processed in 90us (11537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.650231:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135414.650401:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783135414.650409:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809082752:12345-0@lo:13: 00002000:00000024:2.0:1783135414.650421:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135414.650540:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809082752:12345-0@lo:13: Request processed in 64us (7635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.650548:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783135414.650807:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809083008:0@lo:400: 00000100:00100000:2.0:1783135414.650843:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.650870:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809083520:0@lo:400: 00000100:00100000:2.0:1783135414.650892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.650909:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809084032:0@lo:400: 00000100:00100000:2.0:1783135414.650929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.650951:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809084544:0@lo:41: 00000100:00100000:2.0:1783135414.650972:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.650995:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783135414.651001:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809083136:0@lo:400: 00000100:00100000:2.0:1783135414.651021:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.651037:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809083648:0@lo:400: 00000100:00100000:2.0:1783135414.651059:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.651074:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809084160:0@lo:400: 00000100:00100000:2.0:1783135414.651118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.651156:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809083008 00000100:00100000:2.0:1783135414.651161:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809083008 00000100:00100000:2.0:1783135414.651185:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809083520 00000100:00100000:2.0:1783135414.651188:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809083520 00000100:00100000:2.0:1783135414.651201:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809084032 00000100:00100000:2.0:1783135414.651203:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809084032 00000100:00100000:2.0:1783135414.651215:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809083648 00000100:00100000:2.0:1783135414.651217:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809083648 00000100:00100000:2.0:1783135414.651231:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783135414.651237:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809083008:12345-0@lo:400: 00000100:00100000:2.0:1783135414.651303:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809083008:12345-0@lo:400: Request processed in 66us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.651310:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783135414.651325:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783135414.651331:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809083520:12345-0@lo:400: 00000100:00100000:2.0:1783135414.651356:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809083520:12345-0@lo:400: Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.651361:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783135414.651371:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783135414.651377:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809084032:12345-0@lo:400: 00000100:00100000:2.0:1783135414.651397:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809084032:12345-0@lo:400: Request processed in 21us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.651402:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783135414.651410:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783135414.651415:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809083648:12345-0@lo:400: 00000100:00100000:2.0:1783135414.651432:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809083648:12345-0@lo:400: Request processed in 17us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.651437:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783135414.651453:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809084544 00000100:00100000:2.0:1783135414.651455:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809084544 00000100:00100000:2.0:1783135414.651469:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809083136 00000100:00100000:2.0:1783135414.651471:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809083136 00000100:00100000:2.0:1783135414.651480:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783135414.651486:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1869752809084544:12345-0@lo:41: 00000004:00000024:2.0:1783135414.651509:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1783135414.651536:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1869752809084544:12345-0@lo:41: Request processed in 50us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.651546:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783135414.651557:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783135414.651562:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809083136:12345-0@lo:400: 00000100:00100000:2.0:1783135414.651583:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809083136:12345-0@lo:400: Request processed in 21us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.651588:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783135414.651616:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809084160 00000100:00100000:2.0:1783135414.651619:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809084160 00000100:00100000:2.0:1783135414.651643:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135414.651816:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809084160:12345-0@lo:400: 00000100:00100000:2.0:1783135414.651845:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809084160:12345-0@lo:400: Request processed in 197us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.651852:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135414.651884:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809083136:0@lo:400: 00010000:00080000:2.0:1783135414.651895:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84c700 x1869752809083648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135414.651905:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809083648:0@lo:400: 00010000:00080000:2.0:1783135414.651913:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84ea00 x1869752809084160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135414.651920:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809084160:0@lo:400: 00000100:00100000:2.0:1783135414.651930:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809083008:0@lo:400: 00000100:00100000:2.0:1783135414.651939:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809083520:0@lo:400: 00010000:00080000:2.0:1783135414.651948:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84f480 x1869752809084032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135414.651961:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809084032:0@lo:400: 00000100:00100000:2.0:1783135414.651974:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543962680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809084544:0@lo:41: 00000100:00100000:2.0:1783135414.652017:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809083264:0@lo:400: 00000100:00100000:2.0:1783135414.652040:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.652057:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809083776:0@lo:400: 00000100:00100000:2.0:1783135414.652072:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.652084:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809084288:0@lo:400: 00000100:00100000:2.0:1783135414.652121:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.652143:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809083264 00000100:00100000:2.0:1783135414.652146:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809083264 00000100:00100000:2.0:1783135414.652160:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135414.652164:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809083264:12345-0@lo:400: 00000100:00100000:2.0:1783135414.652190:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809083264:12345-0@lo:400: Request processed in 25us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.652195:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135414.652209:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809083776 00000100:00100000:2.0:1783135414.652212:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809083776 00000100:00100000:2.0:1783135414.652229:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809084288 00000100:00100000:2.0:1783135414.652231:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809084288 00000100:00100000:2.0:1783135414.652240:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135414.652407:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809083776:12345-0@lo:400: 00000100:00100000:2.0:1783135414.652435:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809083776:12345-0@lo:400: Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.652441:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135414.652451:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135414.652462:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809084288:12345-0@lo:400: 00000100:00100000:2.0:1783135414.652486:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809084288:12345-0@lo:400: Request processed in 24us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.652491:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135414.652516:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809083264:0@lo:400: 00010000:00080000:2.0:1783135414.652525:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84e300 x1869752809083776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135414.652533:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809083776:0@lo:400: 00010000:00080000:2.0:1783135414.652541:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84d500 x1869752809084288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135414.652548:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809084288:0@lo:400: 00000100:00100000:2.0:1783135414.652625:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135414.652636:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809084672:0@lo:13: 00000100:00100000:2.0:1783135414.652761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135414.652794:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809084672 00000100:00100000:2.0:1783135414.652799:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809084672 00000100:00100000:2.0:1783135414.652817:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783135414.652822:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809084672:12345-0@lo:13: 00002000:00000024:2.0:1783135414.652834:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135414.652863:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809084672:12345-0@lo:13: Request processed in 41us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.652869:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1783135414.652887:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543764a80 x1869752809084672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135414.652898:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809084672:0@lo:13: 00000100:00100000:0.0:1783135414.653226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809082880 00000100:00100000:0.0:1783135414.653233:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809082880 00000100:00100000:0.0:1783135414.653281:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1783135414.653291:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809082880:12345-0@lo:400: 00010000:00080000:3.0:1783135414.653309:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c651880 x1869752809082624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135414.653339:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809082880:12345-0@lo:400: Request processed in 46us (3848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135414.653342:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809082624:0@lo:13: 00000100:00100000:0.0:1783135414.653360:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1783135414.653422:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809082880:0@lo:400: 00000100:00100000:0.0:1783135414.653433:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809083392:0@lo:400: 00000100:00100000:0.0:1783135414.653460:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135414.653485:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809083392 00000100:00100000:0.0:1783135414.653488:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809083392 00000100:00100000:0.0:1783135414.653527:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783135414.653535:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809083392:12345-0@lo:400: 00000100:00100000:0.0:1783135414.653589:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809083392:12345-0@lo:400: Request processed in 53us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135414.653597:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783135414.653626:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809083392:0@lo:400: 00000100:00100000:0.0:1783135414.653633:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809083904:0@lo:400: 00000100:00100000:0.0:1783135414.653677:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135414.653714:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809083904 00000100:00100000:3.0:1783135414.653721:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809083904 00000100:00100000:0.0:1783135414.654328:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809084416:0@lo:13: 00000100:00100000:0.0:1783135414.654361:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783135414.654394:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b3b80 x1869752809082752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135414.654411:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809082752:0@lo:13: 00000100:00100000:0.0:1783135414.654451:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809084416 00000100:00100000:0.0:1783135414.654456:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809084416 00000100:00100000:0.0:1783135414.654481:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783135414.654487:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809084416:12345-0@lo:13: 00002000:00000024:0.0:1783135414.654518:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135414.654556:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809084416:12345-0@lo:13: Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135414.655955:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1783135414.656324:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84c380 x1869752809084416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135414.656350:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809084416:0@lo:13: 00000100:00080000:1.0:1783135414.656366:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135414.656379:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135414.656383:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135414.656387:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135414.658904:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783135414.658945:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809083904:12345-0@lo:400: 00000100:00100000:2.0:1783135414.659112:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809083904:12345-0@lo:400: Request processed in 189us (5445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135414.659121:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783135414.661324:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809083904:0@lo:400: 00010000:00010000:3.0:1783135415.150326:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135416.174650:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135416.952137:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135416.952256:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785964544 00000100:00100000:0.0:1783135416.952270:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785964544 00000100:00100000:0.0:1783135416.952372:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:0.0:1783135416.952386:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:6256:x1869752785964544:12345-192.168.204.6@tcp:41: 00000004:00000024:0.0:1783135416.952449:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783135416.952551:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:6256:x1869752785964544:12345-192.168.204.6@tcp:41: Request processed in 169us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135416.952561:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00080000:1.0:1783135416.953131:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135416.956526:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135416.956716:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785964672 00000100:00100000:2.0:1783135416.956731:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785964672 00000100:00100000:2.0:1783135416.956837:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:2.0:1783135416.956851:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6256:x1869752785964672:12345-192.168.204.6@tcp:41: 00000100:00080000:1.0:1783135416.956997:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1783135416.957056:0:8461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135416.957235:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6256:x1869752785964672:12345-192.168.204.6@tcp:41: Request processed in 386us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135416.957244:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:2.0:1783135416.969458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135416.970479:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785964800 00000100:00100000:0.0:1783135416.970498:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785964800 00000100:00100000:0.0:1783135416.970612:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:0.0:1783135416.970624:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6256:x1869752785964800:12345-192.168.204.6@tcp:13: 00002000:00000024:0.0:1783135416.970671:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135416.970797:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6256:x1869752785964800:12345-192.168.204.6@tcp:13: Request processed in 173us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135416.970806:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00080000:1.0:1783135416.972504:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135416.984809:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135416.985147:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785964928 00000100:00100000:0.0:1783135416.985163:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785964928 00000100:00100000:0.0:1783135416.985324:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:0.0:1783135416.985379:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6256:x1869752785964928:12345-192.168.204.6@tcp:13: 00002000:00000024:0.0:1783135416.985439:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135416.985539:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:6256:x1869752785964928:12345-192.168.204.6@tcp:13: Request processed in 164us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135416.985548:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00080000:1.0:1783135416.985609:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783135417.206871:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135417.711223:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135417.711261:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809084800:0@lo:41: 00000100:00100000:0.0:1783135417.711359:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135417.711458:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809084800 00000100:00100000:0.0:1783135417.711467:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809084800 00000100:00100000:0.0:1783135417.711531:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783135417.711541:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809084800:12345-0@lo:41: 00000004:00000024:0.0:1783135417.711599:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135417.711655:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809084800:12345-0@lo:41: Request processed in 114us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135417.711664:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783135417.711762:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809084800:0@lo:41: 00010000:00010000:0.0:1783135418.233358:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783135418.246341:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00010000:00010000:3.0:1783135419.248029:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135419.251159:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000001:00100000:0.0:1783135419.252598:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000100:00100000:2.0:1783135419.448209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135419.448270:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135419.448408:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785965184 00000100:00100000:0.0:1783135419.448422:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785965184 00000100:00100000:2.0:1783135419.448474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135419.448509:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135419.448543:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135419.448594:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785965312 00000100:00100000:0.0:1783135419.448598:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785965312 00000100:00080000:1.0:1783135419.452340:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135419.452356:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135419.452446:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:1.0:1783135419.452477:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785965184:12345-192.168.204.6@tcp:400: 00000100:00100000:1.0:1783135419.452857:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785965184:12345-192.168.204.6@tcp:400: Request processed in 396us (4663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135419.452901:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:1.0:1783135419.453147:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785965056 00000100:00100000:1.0:1783135419.453159:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785965056 00000100:00100000:1.0:1783135419.453220:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 199 00000100:00100000:1.0:1783135419.453228:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2399:x1869752785965056:12345-192.168.204.6@tcp:400: 00000100:00100000:1.0:1783135419.453275:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2399:x1869752785965056:12345-192.168.204.6@tcp:400: Request processed in 47us (4805us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135419.453281:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 199 00000100:00100000:0.0:1783135419.453896:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:0.0:1783135419.453909:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785965312:12345-192.168.204.6@tcp:400: 00000100:00100000:0.0:1783135419.453960:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785965312:12345-192.168.204.6@tcp:400: Request processed in 55us (5451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135419.453980:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:3.0:1783135419.457056:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785965440 00000100:00100000:3.0:1783135419.457080:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785965440 00000100:00100000:3.0:1783135419.457259:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785965568 00000100:00100000:3.0:1783135419.457263:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785965568 00000100:00100000:3.0:1783135419.457308:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:3.0:1783135419.457321:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785965440:12345-192.168.204.6@tcp:400: 00000100:00100000:2.0:1783135419.457410:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:2.0:1783135419.457426:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785965568:12345-192.168.204.6@tcp:400: 00000100:00100000:3.0:1783135419.457462:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785965440:12345-192.168.204.6@tcp:400: Request processed in 141us (9187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135419.457469:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785965568:12345-192.168.204.6@tcp:400: Request processed in 44us (8921us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135419.457477:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00080000:1.0:1783135419.457530:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135419.457537:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135419.459029:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:0.0:1783135419.758460:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809085056:0@lo:41: 00000100:00100000:0.0:1783135419.758553:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135419.758611:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135419.758618:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809085184:0@lo:13: 00000100:00100000:0.0:1783135419.758648:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135419.758687:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809085056 00000100:00100000:0.0:1783135419.758704:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809085056 00000100:00100000:0.0:1783135419.758765:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135419.758775:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809085056:12345-0@lo:41: 00000004:00000024:0.0:1783135419.758818:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1783135419.758865:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809085056:12345-0@lo:41: Request processed in 91us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135419.758872:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135419.758919:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809085056:0@lo:41: 00000100:00100000:3.0:1783135419.759169:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809085312:0@lo:13: 00000100:00100000:3.0:1783135419.759201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135419.759223:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135419.759230:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809084928:0@lo:13: 00000100:00100000:3.0:1783135419.759251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135419.759278:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809085184 00000100:00100000:3.0:1783135419.759282:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809085184 00000100:00100000:3.0:1783135419.759313:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809085312 00000100:00100000:3.0:1783135419.759316:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809085312 00000100:00100000:3.0:1783135419.759327:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809084928 00000100:00100000:3.0:1783135419.759329:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809084928 00000100:00100000:3.0:1783135419.759341:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783135419.759347:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809085184:12345-0@lo:13: 00002000:00000024:3.0:1783135419.759368:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135419.759402:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809085184:12345-0@lo:13: Request processed in 55us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135419.759408:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783135419.759422:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135419.759427:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809085312:12345-0@lo:13: 00002000:00000024:3.0:1783135419.759442:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135419.759469:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809085312:12345-0@lo:13: Request processed in 41us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135419.759474:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135419.759483:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135419.759499:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809084928:12345-0@lo:13: 00002000:00000024:3.0:1783135419.759509:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135419.759531:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809084928:12345-0@lo:13: Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135419.759536:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1783135419.759551:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135419.759555:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783135419.759571:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b3480 x1869752809084928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135419.759586:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809084928:0@lo:13: 00010000:00080000:3.0:1783135419.759595:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b2a00 x1869752809085312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135419.759604:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809085312:0@lo:13: 00010000:00080000:3.0:1783135419.759630:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b0e00 x1869752809085184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135419.759640:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809085184:0@lo:13: 00000100:00100000:3.0:1783135419.760625:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135419.760643:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809085440:0@lo:13: 00000100:00100000:3.0:1783135419.760687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135419.760882:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809085440 00000100:00100000:0.0:1783135419.760889:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809085440 00000100:00100000:0.0:1783135419.760939:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135419.760947:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809085440:12345-0@lo:13: 00002000:00000024:0.0:1783135419.760966:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135419.761003:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809085440:12345-0@lo:13: Request processed in 58us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135419.761009:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1783135419.761191:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135419.761216:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b3b80 x1869752809085440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135419.761235:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809085440:0@lo:13: 00000100:00100000:0.0:1783135419.762294:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809085568:0@lo:400: 00000100:00100000:0.0:1783135419.762347:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135419.762494:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809085696:0@lo:400: 00000100:00100000:1.0:1783135419.762529:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135419.762566:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809085696 00000100:00100000:1.0:1783135419.762572:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809085696 00000100:00100000:1.0:1783135419.762616:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135419.762624:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809085696:12345-0@lo:400: 00000100:00100000:1.0:1783135419.762672:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809085696:12345-0@lo:400: Request processed in 49us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135419.762678:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135419.762739:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809085696:0@lo:400: 00000100:00100000:2.0:1783135419.762876:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809085568 00000100:00100000:2.0:1783135419.762887:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809085568 00000100:00100000:2.0:1783135419.762925:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1783135419.762932:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809085568:12345-0@lo:400: 00000100:00100000:3.0:1783135419.770205:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809085952:0@lo:400: 00000100:00100000:3.0:1783135419.770280:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135419.770330:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809086464:0@lo:400: 00000100:00100000:3.0:1783135419.770355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135419.770377:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783135419.770382:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809085824:0@lo:400: 00000100:00100000:3.0:1783135419.770400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135419.770416:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809086336:0@lo:400: 00000100:00100000:3.0:1783135419.770435:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135419.770481:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809086464 00000100:00100000:3.0:1783135419.770488:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809086464 00000100:00100000:3.0:1783135419.770541:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809085824 00000100:00100000:3.0:1783135419.770544:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809085824 00000100:00100000:3.0:1783135419.770558:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809086336 00000100:00100000:3.0:1783135419.770561:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809086336 00000100:00100000:3.0:1783135419.770576:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783135419.770585:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809086464:12345-0@lo:400: 00000100:00100000:3.0:1783135419.770637:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809086464:12345-0@lo:400: Request processed in 53us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135419.770644:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783135419.770660:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783135419.770666:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809085824:12345-0@lo:400: 00000100:00100000:3.0:1783135419.770704:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809085824:12345-0@lo:400: Request processed in 38us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135419.770709:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783135419.770720:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783135419.770917:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809086336:12345-0@lo:400: 00000100:00100000:3.0:1783135419.770951:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809086336:12345-0@lo:400: Request processed in 36us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135419.770968:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1783135419.770987:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135419.770991:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135419.771022:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809085824:0@lo:400: 00000100:00100000:3.0:1783135419.771032:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809086336:0@lo:400: 00010000:00080000:3.0:1783135419.771042:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54279b480 x1869752809086464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135419.771052:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809086464:0@lo:400: 00000100:00100000:3.0:1783135419.771199:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809086208:0@lo:400: 00000100:00100000:3.0:1783135419.771227:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135419.771291:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135419.771297:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809086080:0@lo:400: 00000100:00100000:3.0:1783135419.771319:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135419.774108:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809085568:12345-0@lo:400: Request processed in 11154us (11738us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135419.774123:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783135419.776245:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809086208 00000100:00100000:1.0:1783135419.776263:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809086208 00000100:00100000:1.0:1783135419.776335:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809086080 00000100:00100000:1.0:1783135419.776339:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809086080 00000100:00100000:1.0:1783135419.776359:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783135419.776369:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809086208:12345-0@lo:400: 00000100:00100000:0.0:1783135419.778938:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809085568:0@lo:400: 00000100:00100000:1.0:1783135419.779200:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809086208:12345-0@lo:400: Request processed in 2830us (7969us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135419.779212:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783135419.779247:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783135419.779262:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809086080:12345-0@lo:400: 00000100:00100000:1.0:1783135419.779333:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809086080:12345-0@lo:400: Request processed in 78us (8012us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135419.779339:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1783135419.779433:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135419.779439:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135419.779454:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809085952 00000100:00100000:0.0:1783135419.779460:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809085952 00000100:00100000:0.0:1783135419.779523:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135419.779531:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809085952:12345-0@lo:400: 00000100:00100000:0.0:1783135419.779577:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809085952:12345-0@lo:400: Request processed in 47us (9298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135419.779583:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783135419.780154:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809085952:0@lo:400: 00000100:00100000:3.0:1783135419.780191:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809086080:0@lo:400: 00010000:00080000:3.0:1783135419.780205:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c60d880 x1869752809086208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135419.780215:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809086208:0@lo:400: 00010000:00010000:3.0:1783135420.274012:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135420.284530:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000001:02000400:2.0:1783135420.487964:0:10191:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783135421.299233:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135422.320122:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135422.831297:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135422.831331:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809086592:0@lo:41: 00000100:00100000:2.0:1783135422.831424:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135422.831556:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809086592 00000100:00100000:0.0:1783135422.831565:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809086592 00000100:00100000:0.0:1783135422.831617:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135422.831629:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809086592:12345-0@lo:41: 00000004:00000024:0.0:1783135422.831682:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135422.831749:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809086592:12345-0@lo:41: Request processed in 121us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135422.831756:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783135422.832013:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809086592:0@lo:41: 00010000:00010000:3.0:1783135423.359904:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135424.370943:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135424.569659:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135424.569711:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135424.569732:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135424.569763:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135424.569793:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785965824 00000100:00100000:0.0:1783135424.569804:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785965824 00000100:00100000:0.0:1783135424.569861:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785965952 00000100:00100000:0.0:1783135424.569865:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785965952 00000100:00100000:0.0:1783135424.569895:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:0.0:1783135424.569922:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785965824:12345-192.168.204.6@tcp:400: 00000100:00100000:0.0:1783135424.569996:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785965824:12345-192.168.204.6@tcp:400: Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.570003:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:0.0:1783135424.570021:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:0.0:1783135424.570027:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752785965952:12345-192.168.204.6@tcp:400: 00000100:00100000:0.0:1783135424.570051:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752785965952:12345-192.168.204.6@tcp:400: Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.570059:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:0.0:1783135424.570079:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785966208 00000100:00100000:0.0:1783135424.570083:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785966208 00000100:00100000:0.0:1783135424.570137:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:0.0:1783135424.570144:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752785966208:12345-192.168.204.6@tcp:400: 00000100:00100000:0.0:1783135424.570185:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752785966208:12345-192.168.204.6@tcp:400: Request processed in 42us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.570191:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00080000:0.0:1783135424.570207:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135424.570212:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135424.570214:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135424.572317:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785965696 00000100:00100000:1.0:1783135424.572333:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785965696 00000100:00100000:1.0:1783135424.572403:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 201 00000100:00100000:1.0:1783135424.572413:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2401:x1869752785965696:12345-192.168.204.6@tcp:400: 00000100:00100000:1.0:1783135424.572510:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2401:x1869752785965696:12345-192.168.204.6@tcp:400: Request processed in 97us (2796us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.572518:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 201 00000100:00100000:0.0:1783135424.576481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135424.584758:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785966080 00000100:00100000:3.0:1783135424.584774:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785966080 00000100:00100000:3.0:1783135424.584874:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:3.0:1783135424.584885:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785966080:12345-192.168.204.6@tcp:400: 00000100:00100000:3.0:1783135424.584973:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785966080:12345-192.168.204.6@tcp:400: Request processed in 89us (8502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.584981:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00080000:0.0:1783135424.585950:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1783135424.761409:0:10338:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdc1656a0 20000000:00000080:2.0:1783135424.761426:0:10338:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac67c6c9c00 uarg=0000000000000000 20000000:01000000:2.0:1783135424.761467:0:10338:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783135424.761470:0:10338:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783135424.761473:0:10338:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783135424.761477:0:10338:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783135424.761482:0:10338:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783135424.761541:0:10338:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783135424.761543:0:10338:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783135424.762848:0:10339:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1783135424.764369:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1783135424.764411:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1783135424.764430:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1783135424.764447:0:10338:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783135424.764449:0:10338:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783135424.765017:0:10340:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1783135424.768556:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1783135424.768593:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1783135424.768624:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1783135424.768837:0:10338:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1783135424.768841:0:10338:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783135424.769389:0:10341:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1783135424.769582:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1783135424.769619:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1783135424.769648:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1783135424.769659:0:10338:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783135424.769662:0:10338:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783135424.770040:0:10342:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1783135424.770222:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1783135424.770243:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1783135424.770257:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1783135424.770265:0:10338:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783135424.770267:0:10338:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783135424.770550:0:10343:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1783135424.770762:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1783135424.770783:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1783135424.770796:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:2.0:1783135424.770809:0:10338:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783135424.770832:0:10338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770850:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edf857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf850 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770858:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edf881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf87a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770865:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c527e00/0xf7de4ef628edf8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf8b9 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770871:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf8c7 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770878:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edf8dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf8d5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770884:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf8f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf8f1 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770900:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c65ce00/0xf7de4ef628edf922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf914 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770907:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac650989800/0xf7de4ef628edf93e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf937 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770913:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf95a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770924:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac650988200/0xf7de4ef628edf976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140a9f expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770931:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf97d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140aa6 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770938:0:10338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770980:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140aa6 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.770997:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf97d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140aa6 expref: 9 pid: 6516 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.771014:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809086720:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135424.771759:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac650988200/0xf7de4ef628edf976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140a9f expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.771772:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac650988200/0xf7de4ef628edf976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140a9f expref: 9 pid: 6516 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.771792:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809086848:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135424.771909:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf95a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.771917:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf95a expref: 23 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.771926:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809086976:0@lo:104: 00000100:00100000:2.0:1783135424.771962:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135424.772000:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac650989800/0xf7de4ef628edf93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf937 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.772009:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac650989800/0xf7de4ef628edf93e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf937 expref: 23 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.772018:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087104:0@lo:104: 00000100:00100000:2.0:1783135424.772039:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135424.772070:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c65ce00/0xf7de4ef628edf922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf914 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.772078:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c65ce00/0xf7de4ef628edf922 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf914 expref: 23 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.772109:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087232:0@lo:104: 00000100:00100000:2.0:1783135424.772129:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135424.772145:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf8f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf8f1 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.772164:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf8f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf8f1 expref: 23 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.772171:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087360:0@lo:104: 00000100:00100000:2.0:1783135424.772194:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135424.772211:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edf8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf8d5 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.772217:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edf8dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf8d5 expref: 23 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.772224:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087488:0@lo:104: 00010000:00010000:2.0:1783135424.772265:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf8c7 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.772271:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf8ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf8c7 expref: 23 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.772279:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087616:0@lo:104: 00010000:00010000:2.0:1783135424.772302:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c527e00/0xf7de4ef628edf8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf8b9 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.772309:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c527e00/0xf7de4ef628edf8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf8b9 expref: 23 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.772316:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087744:0@lo:104: 00010000:00010000:2.0:1783135424.772336:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edf881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf87a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.772353:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edf881 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf87a expref: 23 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.772361:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087872:0@lo:104: 00010000:00010000:2.0:1783135424.772385:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edf857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf850 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135424.772393:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edf857 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf850 expref: 23 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.772400:0:10338:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809088000:0@lo:104: 00000100:00100000:2.0:1783135424.772416:0:10338:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5def00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135424.772498:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783135424.772516:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135424.772528:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135424.772535:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135424.772542:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135424.772550:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135424.772558:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809086976 00000100:00100000:3.0:1783135424.772564:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809086976 00000100:00100000:3.0:1783135424.772615:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809087104 00000100:00100000:3.0:1783135424.772618:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809087104 00000100:00100000:3.0:1783135424.772701:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809087232 00000100:00100000:3.0:1783135424.772705:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809087232 00000100:00100000:3.0:1783135424.772718:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809087360 00000100:00100000:3.0:1783135424.772721:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809087360 00000100:00100000:3.0:1783135424.772728:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809087488 00000100:00100000:3.0:1783135424.772730:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809087488 00000100:00100000:3.0:1783135424.772738:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809087616 00000100:00100000:3.0:1783135424.772740:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809087616 00000100:00100000:3.0:1783135424.772748:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809087744 00000100:00100000:3.0:1783135424.772750:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809087744 00000100:00100000:3.0:1783135424.772758:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809087872 00000100:00100000:3.0:1783135424.772760:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809087872 00000100:00100000:3.0:1783135424.772768:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809088000 00000100:00100000:3.0:1783135424.772770:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809088000 00000100:00100000:3.0:1783135424.772781:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135424.772789:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:10338:x1869752809086976:12345-0@lo:104: 00010000:00010000:3.0:1783135424.772810:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.772874:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783135424.772882:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+11:10338:x1869752809086976:12345-0@lo:104: Request processed in 93us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.772889:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135424.772908:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135424.772914:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:10338:x1869752809087104:12345-0@lo:104: 00010000:00010000:3.0:1783135424.772920:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.772952:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783135424.772957:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+10:10338:x1869752809087104:12345-0@lo:104: Request processed in 44us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.772963:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135424.772974:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783135424.772979:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:10338:x1869752809087232:12345-0@lo:104: 00010000:00010000:3.0:1783135424.772986:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773017:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783135424.773022:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+9:10338:x1869752809087232:12345-0@lo:104: Request processed in 43us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.773028:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783135424.773039:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135424.773044:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+8:10338:x1869752809087360:12345-0@lo:104: 00010000:00010000:3.0:1783135424.773057:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773119:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783135424.773126:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+8:10338:x1869752809087360:12345-0@lo:104: Request processed in 81us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.773132:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135424.773174:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135424.773179:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+7:10338:x1869752809087488:12345-0@lo:104: 00010000:00010000:3.0:1783135424.773186:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773212:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1783135424.773217:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+7:10338:x1869752809087488:12345-0@lo:104: Request processed in 39us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.773222:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135424.773233:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783135424.773238:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:10338:x1869752809087616:12345-0@lo:104: 00010000:00010000:3.0:1783135424.773244:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773267:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1783135424.773271:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:10338:x1869752809087616:12345-0@lo:104: Request processed in 33us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.773276:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783135424.773287:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135424.773292:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:10338:x1869752809087744:12345-0@lo:104: 00010000:00010000:3.0:1783135424.773305:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773331:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1783135424.773336:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:10338:x1869752809087744:12345-0@lo:104: Request processed in 44us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.773341:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135424.773352:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135424.773357:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:10338:x1869752809087872:12345-0@lo:104: 00010000:00010000:3.0:1783135424.773364:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773388:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1783135424.773392:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:10338:x1869752809087872:12345-0@lo:104: Request processed in 35us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.773397:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135424.773408:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135424.773413:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:10338:x1869752809088000:12345-0@lo:104: 00010000:00010000:3.0:1783135424.773418:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773441:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1783135424.773445:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:10338:x1869752809088000:12345-0@lo:104: Request processed in 34us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.773450:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1783135424.773470:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1783135424.773476:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773489:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135424.773493:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773501:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135424.773508:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135424.773514:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135424.773549:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773555:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135424.773571:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773576:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac650988000/0xf7de4ef628edf95a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773589:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1783135424.773592:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.773608:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988800 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135424.773611:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773758:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783135424.773764:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773770:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b400 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135424.773773:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773787:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135424.773797:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135424.773801:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135424.773817:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773823:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135424.773838:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773845:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b400/0xf7de4ef628edf914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf922 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773856:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783135424.773858:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773863:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65ca00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135424.773866:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773873:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135424.773879:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135424.773889:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135424.773903:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773908:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135424.773914:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773920:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ca00/0xf7de4ef628edf8f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8f8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773930:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783135424.773933:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773938:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a400 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135424.773941:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773947:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135424.773953:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135424.773957:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135424.773969:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773974:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135424.773985:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.773992:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a400/0xf7de4ef628edf8d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8dc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774001:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783135424.774004:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774010:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a200 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135424.774012:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774019:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135424.774024:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135424.774028:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135424.774042:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774047:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135424.774051:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774056:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a200/0xf7de4ef628edf8c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8ce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774064:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783135424.774072:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774078:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135424.774080:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774107:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135424.774114:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135424.774119:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135424.774132:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774137:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135424.774141:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774147:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edf8b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf8c0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774156:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135424.774159:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774165:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51be00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135424.774168:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774183:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135424.774189:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135424.774194:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135424.774208:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774213:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135424.774217:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774222:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51be00/0xf7de4ef628edf87a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf881 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774229:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135424.774231:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774236:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51ac00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135424.774238:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774243:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135424.774248:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135424.774258:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135424.774270:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774275:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135424.774278:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774285:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51ac00/0xf7de4ef628edf850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf857 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.774293:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135424.774295:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135424.774297:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135424.774315:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809088512:0@lo:103: 00000100:00100000:1.0:1783135424.774361:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.774400:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809089024:0@lo:103: 00000100:00100000:1.0:1783135424.774421:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.774442:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783135424.774448:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809088128:0@lo:103: 00000100:00100000:1.0:1783135424.774466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.774479:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809088640:0@lo:103: 00000100:00100000:1.0:1783135424.774494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.774519:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809088256:0@lo:103: 00000100:00100000:1.0:1783135424.774538:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.774547:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809088768:0@lo:103: 00000100:00100000:1.0:1783135424.774574:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.774586:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135424.774591:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809088384:0@lo:103: 00000100:00100000:1.0:1783135424.774624:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135424.775758:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809086976:0@lo:104: 00000100:00100000:2.0:1783135424.775772:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087104:0@lo:104: 00000100:00100000:2.0:1783135424.775782:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087232:0@lo:104: 00000100:00100000:2.0:1783135424.775790:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087360:0@lo:104: 00000100:00100000:2.0:1783135424.775798:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087488:0@lo:104: 00000100:00100000:2.0:1783135424.775806:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087616:0@lo:104: 00000100:00100000:2.0:1783135424.775813:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087744:0@lo:104: 00000100:00100000:2.0:1783135424.775820:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809087872:0@lo:104: 00000100:00100000:2.0:1783135424.775828:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809088000:0@lo:104: 00000100:00100000:1.0:1783135424.776008:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809088896:0@lo:103: 00000100:00100000:1.0:1783135424.776058:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.776118:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809088512 00000100:00100000:1.0:1783135424.776126:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809088512 00010000:00010000:1.0:1783135424.776166:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edf8dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf8d5 expref: 24 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135424.776189:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809089024 00000100:00100000:1.0:1783135424.776193:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809089024 00010000:00010000:1.0:1783135424.776204:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edf857 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf850 expref: 25 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135424.776213:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809088128 00000100:00100000:1.0:1783135424.776216:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809088128 00010000:00010000:1.0:1783135424.776226:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf95a expref: 26 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135424.776235:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809088640 00000100:00100000:1.0:1783135424.776237:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809088640 00010000:00010000:1.0:1783135424.776246:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf8ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf8c7 expref: 27 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135424.776255:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809088256 00000100:00100000:1.0:1783135424.776257:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809088256 00010000:00010000:1.0:1783135424.776288:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c65ce00/0xf7de4ef628edf922 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf914 expref: 28 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135424.776311:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809088768 00000100:00100000:1.0:1783135424.776314:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809088768 00010000:00010000:1.0:1783135424.776325:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c527e00/0xf7de4ef628edf8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf8b9 expref: 29 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135424.776333:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809088384 00000100:00100000:1.0:1783135424.776335:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809088384 00010000:00010000:1.0:1783135424.776345:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf8f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf8f1 expref: 30 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135424.776354:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809088896 00000100:00100000:1.0:1783135424.776356:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809088896 00010000:00010000:1.0:1783135424.776365:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edf881 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf87a expref: 31 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135424.776379:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135424.776388:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac64875d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+31:3648:x1869752809088512:12345-0@lo:103: 00010000:00010000:1.0:1783135424.776403:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135424.776409:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edf8dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf8d5 expref: 31 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.776418:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edf8dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf8d5 expref: 31 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.776437:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edf8dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf8d5 expref: 31 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.776453:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135424.776500:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac64875d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+30:3648:x1869752809088512:12345-0@lo:103: Request processed in 113us (2138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.776513:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135424.776581:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135424.776587:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+29:3648:x1869752809089024:12345-0@lo:103: 00010000:00010000:1.0:1783135424.776609:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135424.776614:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edf857 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf850 expref: 29 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.776622:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edf857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf850 expref: 29 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.777377:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135424.777396:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135424.777402:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135424.777438:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.777444:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135424.777456:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.777463:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628edf937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf93e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.777482:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135424.777483:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135424.777485:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135424.777498:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135424.777504:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135424.777539:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809089152:0@lo:103: 00000100:00100000:3.0:1783135424.777583:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135424.777953:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783135424.777962:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1783135424.777986:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783135424.777993:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809089152 00000100:00100000:0.0:1783135424.777998:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809089152 00010000:00010000:0.0:1783135424.778019:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac650989800/0xf7de4ef628edf93e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf937 expref: 30 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135424.778049:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783135424.778058:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783135424.778066:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+30:3648:x1869752809088128:12345-0@lo:103: 00010000:00010000:0.0:1783135424.778076:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135424.778081:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf961 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf95a expref: 30 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.778382:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809088512:0@lo:103: 00000100:00100000:2.0:1783135424.779827:0:10344:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783135424.779840:0:10344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1783135424.780180:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135424.780196:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+30:3648:x1869752809088640:12345-0@lo:103: 00010000:00010000:3.0:1783135424.780214:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135424.780222:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf8ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf8c7 expref: 30 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135424.780334:0:10345:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:2.0:1783135424.780339:0:10345:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00010000:00010000:0.0:1783135424.780405:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf95a expref: 30 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.780429:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650988400/0xf7de4ef628edf961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf95a expref: 30 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.780443:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135424.780716:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+29:3648:x1869752809088128:12345-0@lo:103: Request processed in 2650us (6246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.780724:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783135424.780749:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135424.780758:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+28:3646:x1869752809088256:12345-0@lo:103: 00010000:00010000:0.0:1783135424.780767:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135424.780773:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c65ce00/0xf7de4ef628edf922 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf914 expref: 28 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.780782:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c65ce00/0xf7de4ef628edf922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf914 expref: 28 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.780792:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65ce00/0xf7de4ef628edf922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf914 expref: 28 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.780812:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135424.780848:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+27:3646:x1869752809088256:12345-0@lo:103: Request processed in 91us (6307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.780854:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135424.780867:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135424.780873:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+26:3646:x1869752809088768:12345-0@lo:103: 00010000:00010000:0.0:1783135424.780882:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135424.780886:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c527e00/0xf7de4ef628edf8c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf8b9 expref: 26 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.780895:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c527e00/0xf7de4ef628edf8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf8b9 expref: 26 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.780904:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527e00/0xf7de4ef628edf8c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf8b9 expref: 26 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.780912:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135424.780933:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:3646:x1869752809088768:12345-0@lo:103: Request processed in 60us (6357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.780938:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135424.780949:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135424.780955:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809088384:12345-0@lo:103: 00010000:00010000:0.0:1783135424.780962:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135424.780968:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf8f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf8f1 expref: 24 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.780976:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf8f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf8f1 expref: 24 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.780993:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf8f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf8f1 expref: 24 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.781002:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135424.781025:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:3646:x1869752809088384:12345-0@lo:103: Request processed in 70us (6401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.781032:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135424.781046:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783135424.781053:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac64875d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:3646:x1869752809088896:12345-0@lo:103: 00010000:00010000:0.0:1783135424.781062:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135424.781066:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edf881 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf87a expref: 22 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.781075:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edf881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf87a expref: 22 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.781084:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edf881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf87a expref: 22 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.781113:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135424.781135:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac64875d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3646:x1869752809088896:12345-0@lo:103: Request processed in 83us (5076us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.781142:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783135424.781155:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783135424.781161:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:3649:x1869752809089152:12345-0@lo:103: 00010000:00010000:0.0:1783135424.781170:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135424.781175:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac650989800/0xf7de4ef628edf93e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf937 expref: 20 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.781202:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac650989800/0xf7de4ef628edf93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf937 expref: 20 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.781212:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650989800/0xf7de4ef628edf93e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf937 expref: 20 pid: 6516 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.781221:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135424.781250:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:3649:x1869752809089152:12345-0@lo:103: Request processed in 90us (3668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.781256:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783135424.781299:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809089152:0@lo:103: 00000100:00100000:0.0:1783135424.781369:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809088384:0@lo:103: 00000100:00100000:0.0:1783135424.781378:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809088896:0@lo:103: 00000100:00100000:0.0:1783135424.781386:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809088256:0@lo:103: 00000100:00100000:0.0:1783135424.781393:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809088768:0@lo:103: 00010000:00010000:1.0:1783135424.781917:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edf857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf850 expref: 18 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135424.781931:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135424.782134:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:3648:x1869752809089024:12345-0@lo:103: Request processed in 5546us (7710us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.782142:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1783135424.782926:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf8c7 expref: 16 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.782944:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edf8ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf8c7 expref: 16 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.782959:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135424.783169:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:3648:x1869752809088640:12345-0@lo:103: Request processed in 2978us (8672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135424.783178:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135424.783305:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809088128:0@lo:103: 00000100:00100000:2.0:1783135424.783316:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809088640:0@lo:103: 00000100:00100000:2.0:1783135424.783324:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809089024:0@lo:103: 00000100:00100000:3.0:1783135424.786058:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135424.786199:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809086720:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135424.786210:0:10338:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1869752809086848:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135424.786257:0:10338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135424.786358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135424.789239:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785966464 00000100:00100000:0.0:1783135424.789255:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785966464 00010000:00010000:0.0:1783135424.789302:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac650988200/0xf7de4ef628edf976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140a9f expref: 10 pid: 6516 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135424.789347:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785966336 00000100:00100000:0.0:1783135424.789352:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785966336 00010000:00010000:0.0:1783135424.789381:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf97d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140aa6 expref: 11 pid: 6516 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135424.789404:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:0.0:1783135424.789414:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:2401:x1869752785966464:12345-192.168.204.6@tcp:103: 00010000:00010000:0.0:1783135424.789431:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135424.789436:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac650988200/0xf7de4ef628edf976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140a9f expref: 11 pid: 6516 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789447:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac650988200/0xf7de4ef628edf976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140a9f expref: 11 pid: 6516 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789464:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650988200/0xf7de4ef628edf976 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140a9f expref: 11 pid: 6516 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789482:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135424.789560:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2401:x1869752785966464:12345-192.168.204.6@tcp:103: Request processed in 147us (3511us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.789568:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:0.0:1783135424.789587:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:0.0:1783135424.789604:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:2401:x1869752785966336:12345-192.168.204.6@tcp:103: 00010000:00010000:0.0:1783135424.789613:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135424.789617:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf97d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140aa6 expref: 9 pid: 6516 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789635:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140aa6 expref: 9 pid: 6516 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789646:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650989600/0xf7de4ef628edf97d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140aa6 expref: 9 pid: 6516 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789665:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789674:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789691:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789698:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789704:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789711:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789718:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135424.789722:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789730:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789746:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135424.789757:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135424.789779:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:2401:x1869752785966336:12345-192.168.204.6@tcp:103: Request processed in 185us (3421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135424.789792:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00010000:00010000:3.0:1783135424.791065:0:10338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.791082:0:10338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135424.791117:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628edf9bc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135424.879523:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809089280:0@lo:400: 00000100:00100000:3.0:1783135424.879607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135424.879661:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809089792:0@lo:400: 00000100:00100000:3.0:1783135424.879684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135424.879707:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809090304:0@lo:400: 00000100:00100000:1.0:1783135424.879842:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809089408:0@lo:400: 00000100:00100000:1.0:1783135424.879885:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.879906:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809089920:0@lo:400: 00000100:00100000:1.0:1783135424.879926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.879944:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809090432:0@lo:400: 00000100:00100000:1.0:1783135424.879964:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.879989:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135424.879994:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809090816:0@lo:13: 00000100:00100000:1.0:1783135424.880017:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.880048:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809089408 00000100:00100000:1.0:1783135424.880055:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809089408 00000100:00100000:1.0:1783135424.880134:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783135424.880144:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809089408:12345-0@lo:400: 00000100:00100000:1.0:1783135424.880223:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809089408:12345-0@lo:400: Request processed in 80us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.880230:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783135424.880255:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809089280 00000100:00100000:1.0:1783135424.880258:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809089280 00000100:00100000:1.0:1783135424.880274:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809089792 00000100:00100000:1.0:1783135424.880276:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809089792 00000100:00100000:1.0:1783135424.880297:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809089920 00000100:00100000:1.0:1783135424.880300:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809089920 00000100:00100000:1.0:1783135424.880313:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809090432 00000100:00100000:1.0:1783135424.880315:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809090432 00000100:00100000:1.0:1783135424.880328:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135424.880334:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809089280:12345-0@lo:400: 00000100:00100000:1.0:1783135424.880367:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809089280:12345-0@lo:400: Request processed in 33us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.880373:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135424.880384:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135424.880390:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809089792:12345-0@lo:400: 00000100:00100000:1.0:1783135424.880415:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809089792:12345-0@lo:400: Request processed in 26us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.880420:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135424.880430:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783135424.880436:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809089920:12345-0@lo:400: 00000100:00100000:1.0:1783135424.880458:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809089920:12345-0@lo:400: Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.880463:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783135424.880473:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783135424.880479:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809090432:12345-0@lo:400: 00000100:00100000:1.0:1783135424.880524:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809090432:12345-0@lo:400: Request processed in 45us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.880530:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783135424.880552:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809090816 00000100:00100000:1.0:1783135424.880556:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809090816 00000100:00100000:1.0:1783135424.880585:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135424.880602:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809090816:12345-0@lo:13: 00002000:00000024:1.0:1783135424.880627:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135424.880657:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809090816:12345-0@lo:13: Request processed in 66us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.880662:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1783135424.880681:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135424.880685:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135424.880687:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783135424.880717:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84ea00 x1869752809090816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135424.880749:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809090816:0@lo:13: 00000100:00100000:1.0:1783135424.880762:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809089408:0@lo:400: 00010000:00080000:1.0:1783135424.880771:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e2d80 x1869752809089920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135424.880780:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809089920:0@lo:400: 00010000:00080000:1.0:1783135424.880789:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e1c00 x1869752809090432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135424.880797:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809090432:0@lo:400: 00000100:00100000:2.0:1783135424.881609:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809089536:0@lo:400: 00000100:00100000:2.0:1783135424.881654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135424.881678:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809090048:0@lo:400: 00000100:00100000:2.0:1783135424.881697:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135424.881715:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809090560:0@lo:400: 00000100:00100000:2.0:1783135424.881751:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135424.881778:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809091072:0@lo:13: 00000100:00100000:2.0:1783135424.881798:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135424.881816:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1783135424.881823:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809089664:0@lo:400: 00000100:00100000:2.0:1783135424.881845:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135424.881871:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809090176:0@lo:400: 00000100:00100000:2.0:1783135424.881892:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135424.881907:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809090688:0@lo:400: 00000100:00100000:2.0:1783135424.881926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135424.881958:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809091200:0@lo:13: 00000100:00100000:2.0:1783135424.881977:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135424.882003:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809090048 00000100:00100000:2.0:1783135424.882009:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809090048 00000100:00100000:2.0:1783135424.882038:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809090560 00000100:00100000:2.0:1783135424.882040:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809090560 00000100:00100000:2.0:1783135424.882058:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809090176 00000100:00100000:2.0:1783135424.882060:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809090176 00000100:00100000:2.0:1783135424.882071:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809090688 00000100:00100000:2.0:1783135424.882073:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809090688 00000100:00100000:2.0:1783135424.882117:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135424.882125:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809090048:12345-0@lo:400: 00000100:00100000:2.0:1783135424.882360:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809090048:12345-0@lo:400: Request processed in 235us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135424.882369:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135424.882389:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135424.882395:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809090560:12345-0@lo:400: 00000100:00100000:2.0:1783135424.882423:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809090560:12345-0@lo:400: Request processed in 28us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135424.882429:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135424.882440:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783135424.882445:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809090176:12345-0@lo:400: 00000100:00100000:2.0:1783135424.882471:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809090176:12345-0@lo:400: Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135424.882477:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783135424.882487:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783135424.882492:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809090688:12345-0@lo:400: 00000100:00100000:2.0:1783135424.882517:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809090688:12345-0@lo:400: Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135424.882529:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1783135424.882574:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e1880 x1869752809090176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135424.882586:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809090176:0@lo:400: 00010000:00080000:2.0:1783135424.882607:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e0000 x1869752809090688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135424.882615:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809090688:0@lo:400: 00010000:00080000:2.0:1783135424.882626:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e1f80 x1869752809090048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135424.882634:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809090048:0@lo:400: 00010000:00080000:2.0:1783135424.882642:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e2680 x1869752809090560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135424.882649:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809090560:0@lo:400: 00000100:00100000:3.0:1783135424.882737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135424.882792:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809089280:0@lo:400: 00000100:00100000:3.0:1783135424.882804:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809089792:0@lo:400: 00000100:00100000:3.0:1783135424.882827:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135424.882835:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809090944:0@lo:13: 00000100:00100000:2.0:1783135424.883262:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809089536 00000100:00100000:2.0:1783135424.883270:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809089536 00000100:00100000:2.0:1783135424.883296:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809090304 00000100:00100000:2.0:1783135424.883299:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809090304 00000100:00100000:2.0:1783135424.883317:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783135424.883322:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809089536:12345-0@lo:400: 00000100:00100000:2.0:1783135424.883370:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809089536:12345-0@lo:400: Request processed in 47us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135424.883376:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783135424.883388:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783135424.883394:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809090304:12345-0@lo:400: 00000100:00100000:2.0:1783135424.883446:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809090304:12345-0@lo:400: Request processed in 52us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135424.883452:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783135424.883485:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809089536:0@lo:400: 00000100:00100000:3.0:1783135424.883826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135424.883930:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809090304:0@lo:400: 00000100:00100000:2.0:1783135424.885064:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809091328:0@lo:41: 00000100:00100000:2.0:1783135424.885131:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.885263:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809091072 00000100:00100000:1.0:1783135424.885278:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809091072 00000100:00100000:1.0:1783135424.885309:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809091200 00000100:00100000:1.0:1783135424.885312:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809091200 00000100:00100000:1.0:1783135424.885321:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809090944 00000100:00100000:1.0:1783135424.885323:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809090944 00000100:00100000:1.0:1783135424.885337:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135424.885344:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809091072:12345-0@lo:13: 00002000:00000024:1.0:1783135424.885367:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135424.885415:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809091072:12345-0@lo:13: Request processed in 71us (3615us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.885421:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135424.885436:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135424.885441:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809091200:12345-0@lo:13: 00002000:00000024:1.0:1783135424.885457:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135424.885480:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809091200:12345-0@lo:13: Request processed in 39us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.885484:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135424.885494:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135424.885500:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809090944:12345-0@lo:13: 00002000:00000024:1.0:1783135424.885509:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135424.885530:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809090944:12345-0@lo:13: Request processed in 31us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.885536:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135424.885554:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809089664 00000100:00100000:1.0:1783135424.885557:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809089664 00000100:00100000:1.0:1783135424.885573:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809091328 00000100:00100000:1.0:1783135424.885576:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809091328 00000100:00100000:1.0:1783135424.885587:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135424.885603:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809089664:12345-0@lo:400: 00000100:00100000:1.0:1783135424.885647:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809089664:12345-0@lo:400: Request processed in 53us (3799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.885654:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135424.885666:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135424.885672:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809091328:12345-0@lo:41: 00000004:00000024:1.0:1783135424.885697:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783135424.885739:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809091328:12345-0@lo:41: Request processed in 66us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.885744:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1783135424.885762:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135424.885767:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135424.885769:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135424.885811:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809089664:0@lo:400: 00010000:00080000:1.0:1783135424.885826:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b2300 x1869752809091200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135424.885841:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809091200:0@lo:13: 00010000:00080000:1.0:1783135424.886251:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b0380 x1869752809091072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135424.886274:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809091072:0@lo:13: 00000100:00100000:2.0:1783135424.886379:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809091328:0@lo:41: 00010000:00080000:2.0:1783135424.886391:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b2d80 x1869752809090944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135424.886401:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809090944:0@lo:13: 00010000:00010000:1.0:1783135425.394012:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783135426.158467:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783135426.158476:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac67e2d9800 from 48 10000000:01000000:3.0:1783135426.158491:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783135426.158543:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.158555:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.158567:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135426.158601:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809091456:0@lo:101: 00000100:00100000:3.0:1783135426.158833:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.158914:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.158936:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809091456 00000100:00100000:2.0:1783135426.158944:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809091456 00000100:00100000:2.0:1783135426.158994:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1783135426.159004:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+15:6519:x1869752809091456:12345-0@lo:101: 00010000:00010000:2.0:1783135426.159019:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135426.159033:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628edf9ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf9c3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.159055:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628edf9ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf9c3 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.159066:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628edf9ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf9c3 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.159121:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20fe00, rc 0) 00000100:00100000:2.0:1783135426.159537:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809091456:12345-0@lo:101: Request processed in 533us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.159559:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1783135426.160476:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809091456:0@lo:101: 00010000:00010000:3.0:1783135426.160513:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.160524:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135426.160621:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809091584:0@lo:501: 00000100:00100000:3.0:1783135426.160660:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.160768:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135426.167102:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809091584 00000100:00100000:1.0:1783135426.167116:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809091584 00000100:00100000:1.0:1783135426.167194:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783135426.167203:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809091584:12345-0@lo:501: 00000100:00100000:3.0:1783135426.169220:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809091584:12345-0@lo:501: Request processed in 2009us (8550us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135426.169233:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1783135426.169527:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809091584:0@lo:501: 00000100:00100000:0.0:1783135426.169592:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809091712:0@lo:503: 00000100:00100000:0.0:1783135426.169659:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.169783:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809091712 00000100:00100000:2.0:1783135426.169791:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809091712 00000100:00100000:2.0:1783135426.169841:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783135426.169850:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809091712:12345-0@lo:503: 00000100:00100000:2.0:1783135426.169956:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809091712:12345-0@lo:503: Request processed in 107us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.169962:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1783135426.170268:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54328be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.170285:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809091712:0@lo:503: 00000100:00100000:0.0:1783135426.170731:0:10358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10358:1869752809091840:0@lo:502: 00000100:00100000:0.0:1783135426.170774:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135426.170838:0:10358:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54328ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.176232:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809091840 00000100:00100000:2.0:1783135426.176470:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809091840 00000100:00100000:2.0:1783135426.176628:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1783135426.176639:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:10358:x1869752809091840:12345-0@lo:502: 00000100:00100000:2.0:1783135426.176842:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:10358:x1869752809091840:12345-0@lo:502: Request processed in 204us (6066us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.176850:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783135426.176952:0:10358:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10358:1869752809091840:0@lo:502: 00000100:00100000:3.0:1783135426.177015:0:10358:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10358:1869752809091968:0@lo:502: 00000100:00100000:3.0:1783135426.177060:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.183544:0:10358:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.183936:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809091968 00000100:00100000:0.0:1783135426.183947:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809091968 00000100:00100000:0.0:1783135426.184004:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783135426.184017:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:10358:x1869752809091968:12345-0@lo:502: 00000100:00100000:0.0:1783135426.184217:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:10358:x1869752809091968:12345-0@lo:502: Request processed in 202us (7156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.184225:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1783135426.184355:0:10358:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10358:1869752809091968:0@lo:502: 00000040:00080000:3.0:1783135426.184407:0:10358:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783135426.185084:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1783135426.185136:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135426.185148:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.185159:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135426.185169:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783135426.185171:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1783135426.185174:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783135426.185209:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.185232:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.186346:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135426.186376:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092096:0@lo:101: 00000100:00100000:3.0:1783135426.186441:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.186766:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.187186:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809092096 00000100:00100000:0.0:1783135426.187193:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809092096 00000100:00100000:0.0:1783135426.187233:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783135426.187242:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+16:6519:x1869752809092096:12345-0@lo:101: 00010000:00010000:0.0:1783135426.187256:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135426.187271:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65c400/0xf7de4ef628edf9d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf9d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.187296:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65c400/0xf7de4ef628edf9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf9d1 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.187318:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65c400/0xf7de4ef628edf9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf9d1 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.187327:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c400, rc 0) 00000100:00100000:0.0:1783135426.187453:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809092096:12345-0@lo:101: Request processed in 211us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.187460:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783135426.187528:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092096:0@lo:101: 00010000:00010000:3.0:1783135426.187546:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.187556:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135426.187643:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092224:0@lo:501: 00000100:00100000:3.0:1783135426.187671:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.187699:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.187811:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809092224 00000100:00100000:0.0:1783135426.187830:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809092224 00000100:00100000:0.0:1783135426.187849:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1783135426.187855:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809092224:12345-0@lo:501: 00000100:00100000:0.0:1783135426.187982:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809092224:12345-0@lo:501: Request processed in 126us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.187989:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1783135426.188192:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092224:0@lo:501: 00000100:00100000:3.0:1783135426.188219:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092352:0@lo:503: 00000100:00100000:3.0:1783135426.188273:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.188297:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.188353:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809092352 00000100:00100000:2.0:1783135426.188358:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809092352 00000100:00100000:2.0:1783135426.188384:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1783135426.188390:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809092352:12345-0@lo:503: 00000100:00100000:2.0:1783135426.188477:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809092352:12345-0@lo:503: Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.188484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783135426.188564:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092352:0@lo:503: 00000100:00100000:3.0:1783135426.189456:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10359:1869752809092480:0@lo:502: 00000100:00100000:3.0:1783135426.189510:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.189545:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.189598:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809092480 00000100:00100000:2.0:1783135426.189603:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809092480 00000100:00100000:2.0:1783135426.189647:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1783135426.189654:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:10359:x1869752809092480:12345-0@lo:502: 00000100:00100000:2.0:1783135426.190251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:10359:x1869752809092480:12345-0@lo:502: Request processed in 595us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.190259:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1783135426.190449:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10359:1869752809092480:0@lo:502: 00000020:01000000:3.0:1783135426.190478:0:10359:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135426.190487:0:10359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135426.190489:0:10359:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783135426.190493:0:10359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783135426.190518:0:10359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10359:1869752809092608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135426.190559:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.190696:0:10359:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.193364:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809092608 00000100:00100000:0.0:1783135426.193379:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809092608 00000100:00100000:0.0:1783135426.193493:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1783135426.193505:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:10359:x1869752809092608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135426.193808:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:10359:x1869752809092608:12345-0@lo:502:llog_process_th.0 Request processed in 305us (3247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.193829:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1783135426.194056:0:10359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10359:1869752809092608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135426.194130:0:10359:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135426.194138:0:10359:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135426.194141:0:10359:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783135426.194145:0:10359:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1783135426.194336:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1783135426.194355:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783135426.194365:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.194374:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135426.194383:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783135426.194385:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac67c2fd800 from 48 10000000:01000000:2.0:1783135426.194388:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135426.194429:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.194436:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.194445:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135426.194465:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.194503:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.194542:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135426.194738:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809092736 00000100:00100000:1.0:1783135426.194753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809092736 00000100:00100000:1.0:1783135426.194790:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1783135426.194799:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+17:6519:x1869752809092736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135426.194810:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135426.194923:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51ac00/0xf7de4ef628edf9e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf9df expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135426.194946:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51ac00/0xf7de4ef628edf9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf9df expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135426.194957:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51ac00/0xf7de4ef628edf9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf9df expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135426.194966:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51ac00, rc 0) 00000100:00100000:1.0:1783135426.195013:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809092736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135426.195019:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783135426.195122:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135426.195136:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.195145:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135426.195203:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.195231:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.195250:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135426.195291:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809092864 00000100:00100000:1.0:1783135426.195295:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809092864 00000100:00100000:1.0:1783135426.195312:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783135426.195318:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809092864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135426.195430:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809092864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135426.195437:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783135426.195496:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.195521:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.195561:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.195588:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135426.198733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809092992 00000100:00100000:1.0:1783135426.198749:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809092992 00000100:00100000:1.0:1783135426.198804:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783135426.198814:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809092992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135426.199134:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809092992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 321us (3571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135426.199142:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783135426.199210:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809092992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135426.199423:0:10360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10360:1869752809093120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135426.199465:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135426.199486:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809093120 00000100:00100000:1.0:1783135426.199490:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809093120 00000100:00100000:1.0:1783135426.199506:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783135426.199512:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:10360:x1869752809093120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135426.200412:0:10360:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135426.200780:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:10360:x1869752809093120:12345-0@lo:502:llog_process_th.0 Request processed in 1265us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135426.200790:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1783135426.201039:0:10360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10360:1869752809093120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135426.201127:0:10360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10360:1869752809093248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135426.201171:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135426.201253:0:10360:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c4813c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.201336:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809093248 00000100:00100000:2.0:1783135426.201343:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809093248 00000100:00100000:3.0:1783135426.201495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1783135426.201506:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:10360:x1869752809093248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135426.201650:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:10360:x1869752809093248:12345-0@lo:502:llog_process_th.0 Request processed in 146us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135426.201657:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783135426.201725:0:10360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10360:1869752809093248:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783135426.201746:0:10360:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783135426.202077:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783135426.202139:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135426.202149:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.202159:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135426.202167:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783135426.202169:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1783135426.202172:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783135426.202197:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.202205:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.202214:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135426.202229:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809093376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.202262:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.202481:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5de900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.202547:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809093376 00000100:00100000:0.0:1783135426.202552:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809093376 00000100:00100000:0.0:1783135426.208742:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1783135426.208767:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+18:6519:x1869752809093376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135426.208787:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135426.208810:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf9f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf9ed expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.208847:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf9ed expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.208859:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf9ed expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.208867:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65da00, rc 0) 00000100:00100000:0.0:1783135426.208950:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809093376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (6686us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.208956:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783135426.209170:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809093376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135426.209189:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.209198:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135426.209286:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809093504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.209334:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.209373:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5de900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.209501:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809093504 00000100:00100000:0.0:1783135426.209508:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809093504 00000100:00100000:0.0:1783135426.209534:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1783135426.209540:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809093504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135426.209687:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809093504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.209694:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783135426.209820:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809093504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.209849:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809093632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.209888:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.209908:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5de900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.210068:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809093632 00000100:00100000:0.0:1783135426.210073:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809093632 00000100:00100000:0.0:1783135426.210127:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783135426.210140:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809093632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135426.210220:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809093632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.210227:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1783135426.210445:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809093632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135426.211490:0:10361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10361:1869752809093760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135426.211546:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135426.211592:0:10361:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c481d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.211759:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809093760 00000100:00100000:2.0:1783135426.211766:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809093760 00000100:00100000:2.0:1783135426.211807:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783135426.211815:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:10361:x1869752809093760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135426.211925:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:10361:x1869752809093760:12345-0@lo:502:llog_process_th.0 Request processed in 109us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.211932:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783135426.212124:0:10361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10361:1869752809093760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135426.212149:0:10361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135426.212158:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135426.212160:0:10361:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783135426.212165:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783135426.212183:0:10361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10361:1869752809093888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135426.212211:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135426.212230:0:10361:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c481d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.212277:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809093888 00000100:00100000:2.0:1783135426.212280:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809093888 00000100:00100000:2.0:1783135426.212301:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1783135426.212306:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:10361:x1869752809093888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135426.212367:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:10361:x1869752809093888:12345-0@lo:502:llog_process_th.0 Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.212373:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783135426.212638:0:10361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10361:1869752809093888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135426.212655:0:10361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135426.212659:0:10361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135426.212671:0:10361:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783135426.212675:0:10361:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1783135426.212872:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1783135426.212896:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783135426.212905:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.212928:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135426.212939:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783135426.212941:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac6743ed800 from 48 10000000:01000000:2.0:1783135426.212944:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135426.212969:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.212976:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.212984:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135426.213000:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.213028:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.213058:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135426.213260:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809094016 00000100:00100000:3.0:1783135426.213266:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809094016 00000100:00100000:3.0:1783135426.213298:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1783135426.213305:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:6519:x1869752809094016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135426.213316:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135426.213328:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527200/0xf7de4ef628edfa02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edf9fb expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.213348:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527200/0xf7de4ef628edfa02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edf9fb expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.213357:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527200/0xf7de4ef628edfa02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf9fb expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.213366:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527200, rc 0) 00000100:00100000:3.0:1783135426.213410:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809094016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135426.213415:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1783135426.213493:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135426.213505:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.213513:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135426.213558:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.213597:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.213642:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.213791:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809094144 00000100:00100000:0.0:1783135426.213795:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809094144 00000100:00100000:0.0:1783135426.213827:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783135426.213834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809094144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135426.213951:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809094144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.213967:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1783135426.214059:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.214113:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.214153:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.214168:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135426.214254:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809094272 00000100:00100000:3.0:1783135426.214259:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809094272 00000100:00100000:3.0:1783135426.214287:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783135426.214301:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809094272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.214375:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809094272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135426.214381:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783135426.214483:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.214959:0:10362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10362:1869752809094400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135426.214997:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.215033:0:10362:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43e180 going to sleep for 11 seconds 00000100:00100000:3.0:1783135426.215071:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809094400 00000100:00100000:3.0:1783135426.215075:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809094400 00000100:00100000:3.0:1783135426.215169:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1783135426.215177:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:10362:x1869752809094400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135426.215267:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:10362:x1869752809094400:12345-0@lo:502:llog_process_th.0 Request processed in 91us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135426.215274:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783135426.215459:0:10362:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10362:1869752809094400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135426.215496:0:10362:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10362:1869752809094528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135426.215526:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.215553:0:10362:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.215597:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809094528 00000100:00100000:0.0:1783135426.215601:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809094528 00000100:00100000:0.0:1783135426.215641:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783135426.215647:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:10362:x1869752809094528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135426.215729:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:10362:x1869752809094528:12345-0@lo:502:llog_process_th.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.215735:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1783135426.215843:0:10362:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10362:1869752809094528:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783135426.215862:0:10362:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1783135426.216315:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1783135426.216339:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783135426.216351:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.216362:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135426.216371:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1783135426.216373:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1783135426.216376:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1783135426.216403:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.216410:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.216420:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135426.216434:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135426.216474:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135426.216507:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c481300 going to sleep for 11 seconds 00000100:00100000:1.0:1783135426.216548:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809094656 00000100:00100000:1.0:1783135426.216553:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809094656 00000100:00100000:1.0:1783135426.216599:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783135426.216616:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809094656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135426.216625:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135426.216638:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51be00/0xf7de4ef628edfa10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfa09 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135426.216659:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51be00/0xf7de4ef628edfa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfa09 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135426.216693:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51be00/0xf7de4ef628edfa10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa09 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135426.216702:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51be00, rc 0) 00000100:00100000:1.0:1783135426.216743:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809094656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135426.216750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1783135426.216889:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135426.216901:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.216910:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135426.216974:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.217000:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.217023:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135426.217141:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809094784 00000100:00100000:1.0:1783135426.217146:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809094784 00000100:00100000:1.0:1783135426.217174:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1783135426.217180:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809094784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135426.217287:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809094784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135426.217294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1783135426.217448:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.217477:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.217512:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.217538:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.217607:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809094912 00000100:00100000:0.0:1783135426.217612:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809094912 00000100:00100000:0.0:1783135426.217644:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1783135426.217650:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809094912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135426.217733:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809094912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.217740:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783135426.217837:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809094912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.221880:0:10363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10363:1869752809095040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135426.221970:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.222046:0:10363:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.222083:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809095040 00000100:00100000:0.0:1783135426.222460:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809095040 00000100:00100000:0.0:1783135426.222536:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1783135426.222547:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:10363:x1869752809095040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135426.222841:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:10363:x1869752809095040:12345-0@lo:502:llog_process_th.0 Request processed in 294us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.222850:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1783135426.222937:0:10363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10363:1869752809095040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135426.222971:0:10363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135426.222981:0:10363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135426.222983:0:10363:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783135426.222988:0:10363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783135426.223014:0:10363:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10363:1869752809095168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135426.223048:0:10363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.223995:0:10363:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.224042:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809095168 00000100:00100000:2.0:1783135426.224048:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809095168 00000100:00100000:0.0:1783135426.224112:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1783135426.224122:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:10363:x1869752809095168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135426.224252:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:10363:x1869752809095168:12345-0@lo:502:llog_process_th.0 Request processed in 131us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.224259:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1783135426.224428:0:10363:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10363:1869752809095168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135426.224456:0:10363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135426.224464:0:10363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135426.224467:0:10363:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783135426.224471:0:10363:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1783135426.225127:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1783135426.225151:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783135426.225161:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135426.225172:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135426.225182:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783135426.225184:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac64382e000 from 48 10000000:01000000:1.0:1783135426.225188:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135426.225218:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135426.225252:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135426.225263:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135426.225282:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809095296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135426.225331:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135426.225363:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.225508:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809095296 00000100:00100000:2.0:1783135426.225514:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809095296 00000100:00100000:2.0:1783135426.225551:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1783135426.225560:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809095296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135426.225580:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135426.225594:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628edfa1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfa17 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.226309:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628edfa1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfa17 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.226320:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628edfa1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa17 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.226328:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f200, rc 0) 00000100:00100000:2.0:1783135426.226472:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809095296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 913us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.226488:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1783135426.226819:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809095296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135426.226836:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.226845:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135426.226909:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809095424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.226941:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.229001:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135426.229078:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809095424 00000100:00100000:1.0:1783135426.229365:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809095424 00000100:00100000:1.0:1783135426.229456:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1783135426.229466:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809095424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135426.229654:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809095424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135426.229671:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783135426.229748:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809095424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.229799:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809095552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.229853:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.230054:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.230157:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809095552 00000100:00100000:2.0:1783135426.230163:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809095552 00000100:00100000:2.0:1783135426.230190:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1783135426.230197:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809095552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.230298:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809095552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.230305:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783135426.230398:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809095552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.231125:0:10364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10364:1869752809095680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135426.231176:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.231207:0:10364:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.232246:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809095680 00000100:00100000:2.0:1783135426.232255:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809095680 00000100:00100000:2.0:1783135426.232290:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783135426.232297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:10364:x1869752809095680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135426.232420:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:10364:x1869752809095680:12345-0@lo:502:llog_process_th.0 Request processed in 122us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.232426:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783135426.232509:0:10364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10364:1869752809095680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135426.232559:0:10364:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10364:1869752809095808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135426.232624:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.232651:0:10364:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.232819:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809095808 00000100:00100000:2.0:1783135426.232824:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809095808 00000100:00100000:2.0:1783135426.232850:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783135426.232855:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:10364:x1869752809095808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135426.232924:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:10364:x1869752809095808:12345-0@lo:502:llog_process_th.0 Request processed in 68us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.232931:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783135426.232992:0:10364:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10364:1869752809095808:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783135426.233012:0:10364:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1783135426.233226:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1783135426.233250:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135426.233261:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.233272:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135426.233281:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783135426.233283:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1783135426.233286:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783135426.233312:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.233319:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.233327:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135426.233340:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809095936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.233371:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.233403:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43e000 going to sleep for 11 seconds 00000100:00100000:3.0:1783135426.234036:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809095936 00000100:00100000:3.0:1783135426.234044:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809095936 00000100:00100000:3.0:1783135426.234075:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783135426.234082:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809095936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135426.234121:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135426.234135:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527c00/0xf7de4ef628edfa2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfa25 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.234159:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527c00/0xf7de4ef628edfa2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfa25 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.234185:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527c00/0xf7de4ef628edfa2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa25 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.234193:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527c00, rc 0) 00000100:00100000:3.0:1783135426.234243:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809095936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135426.234249:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783135426.234418:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809095936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135426.234439:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135426.234449:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135426.234513:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809096064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.234542:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.235926:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135426.237285:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809096064 00000100:00100000:1.0:1783135426.237297:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809096064 00000100:00100000:1.0:1783135426.237351:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783135426.237361:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809096064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135426.237538:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809096064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135426.237546:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1783135426.237565:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809096064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.237638:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809096192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135426.237700:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135426.237732:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b43e000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.237870:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809096192 00000100:00100000:0.0:1783135426.237875:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809096192 00000100:00100000:0.0:1783135426.237907:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1783135426.237914:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809096192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135426.238005:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809096192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.238019:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1783135426.238084:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809096192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135426.238981:0:10365:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10365:1869752809096320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135426.239035:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135426.239081:0:10365:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5430729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135426.239543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809096320 00000100:00100000:3.0:1783135426.239549:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809096320 00000100:00100000:3.0:1783135426.239601:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1783135426.239759:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:10365:x1869752809096320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135426.239884:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:10365:x1869752809096320:12345-0@lo:502:llog_process_th.0 Request processed in 127us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135426.239939:0:10365:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10365:1869752809096320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135426.239969:0:10365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135426.239979:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135426.239982:0:10365:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783135426.239987:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783135426.240009:0:10365:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10365:1869752809096448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135426.240044:0:10365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135426.240077:0:10365:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5430729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135426.240932:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809096448 00000100:00100000:2.0:1783135426.240941:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809096448 00000100:00100000:3.0:1783135426.241843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1783135426.242046:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1783135426.242058:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:10365:x1869752809096448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135426.242337:0:10365:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10365:1869752809096448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135426.242367:0:10365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135426.242375:0:10365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135426.242377:0:10365:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783135426.242381:0:10365:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:2.0:1783135426.244138:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:10365:x1869752809096448:12345-0@lo:502:llog_process_th.0 Request processed in 2075us (4084us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135426.244153:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:01000000:3.0:1783135426.244271:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1783135426.244301:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783135426.244313:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.244323:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135426.244334:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783135426.244336:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ac66b5899c0 from 1 10000000:01000000:3.0:1783135426.244338:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783135426.244368:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628edfa33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.244390:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628edfa33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.244401:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628edfa33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135426.244420:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809096576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.244468:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.244798:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.244854:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809096576 00000100:00100000:0.0:1783135426.244861:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809096576 00000100:00100000:0.0:1783135426.244896:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783135426.244905:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809096576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135426.244918:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135426.244931:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edfa3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfa33 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.244954:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edfa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfa33 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.244964:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edfa3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa33 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135426.244986:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65dc00, rc 0) 00000100:00100000:0.0:1783135426.245040:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809096576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135426.245045:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1783135426.245137:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809096576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135426.245153:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628edfa33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa3a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.245161:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628edfa33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa3a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135426.245221:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809096704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135426.245261:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.245275:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135426.245393:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809096704 00000100:00100000:0.0:1783135426.245398:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809096704 00000100:00100000:0.0:1783135426.245415:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783135426.245420:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809096704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135426.245501:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809096704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135426.245507:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783135426.245576:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809096704:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783135426.245601:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783135426.245682:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628edfa33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa3a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.245690:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628edfa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa3a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135426.414254:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135427.441479:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135427.896006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135427.896134:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785966592 00000100:00100000:2.0:1783135427.896144:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785966592 00000100:00100000:2.0:1783135427.896202:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 244 00000100:00100000:2.0:1783135427.896213:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:6176:x1869752785966592:12345-192.168.204.6@tcp:101: 00010000:00010000:2.0:1783135427.896238:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135427.896326:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20fa00/0xf7de4ef628edfa41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140b16 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135427.896357:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20fa00/0xf7de4ef628edfa41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b16 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135427.896370:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20fa00/0xf7de4ef628edfa41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b16 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135427.896380:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20fa00, rc 0) 00000100:00100000:2.0:1783135427.896444:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6176:x1869752785966592:12345-192.168.204.6@tcp:101: Request processed in 233us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135427.896450:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 244 00000100:00100000:0.0:1783135427.905722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135427.905918:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785966720 00000100:00100000:1.0:1783135427.905929:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785966720 00000100:00100000:1.0:1783135427.905975:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 245 00000100:00100000:1.0:1783135427.905986:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6176:x1869752785966720:12345-192.168.204.6@tcp:501: 00000100:00100000:1.0:1783135427.906176:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6176:x1869752785966720:12345-192.168.204.6@tcp:501: Request processed in 192us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135427.906184:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 245 00000100:00100000:0.0:1783135427.909135:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135427.909342:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785966848 00000100:00100000:2.0:1783135427.909351:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785966848 00000100:00100000:2.0:1783135427.909406:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 246 00000100:00100000:2.0:1783135427.909416:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6176:x1869752785966848:12345-192.168.204.6@tcp:503: 00000100:00100000:2.0:1783135427.909980:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6176:x1869752785966848:12345-192.168.204.6@tcp:503: Request processed in 562us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135427.909988:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 246 00000100:00100000:0.0:1783135427.917270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135427.918593:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785966976 00000100:00100000:1.0:1783135427.918608:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785966976 00000100:00100000:1.0:1783135427.918679:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 247 00000100:00100000:1.0:1783135427.918690:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac641681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6663:x1869752785966976:12345-192.168.204.6@tcp:502: 00000100:00100000:1.0:1783135427.918857:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac641681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6663:x1869752785966976:12345-192.168.204.6@tcp:502: Request processed in 169us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135427.918874:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 247 00000100:00100000:0.0:1783135427.933348:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135427.933747:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785967104 00000100:00100000:2.0:1783135427.933768:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785967104 00000100:00100000:2.0:1783135427.933827:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 248 00000100:00100000:2.0:1783135427.933837:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6663:x1869752785967104:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135427.933991:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6663:x1869752785967104:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 155us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135427.934008:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 248 00000100:00100000:1.0:1783135427.952649:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809096832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135427.952737:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135427.952905:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809096832 00000100:00100000:3.0:1783135427.952915:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809096832 00000100:00100000:3.0:1783135427.952970:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135427.952979:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809096832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135427.953016:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783135427.953067:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809096832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135427.953074:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783135427.953264:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809096832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135427.963738:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135427.963952:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785967232 00000100:00100000:2.0:1783135427.963965:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785967232 00000100:00100000:2.0:1783135427.964030:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 249 00000100:00100000:2.0:1783135427.964042:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6176:x1869752785967232:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135427.964061:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135427.964110:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20ea00/0xf7de4ef628edfa48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140b1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135427.964138:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20ea00/0xf7de4ef628edfa48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b1d expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135427.964147:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20ea00/0xf7de4ef628edfa48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b1d expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135427.964156:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20ea00, rc 0) 00000100:00100000:2.0:1783135427.964215:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6176:x1869752785967232:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 176us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135427.964222:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 249 00000100:00100000:0.0:1783135427.967992:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135427.968112:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785967360 00000100:00100000:1.0:1783135427.968123:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785967360 00000100:00100000:1.0:1783135427.968184:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 250 00000100:00100000:1.0:1783135427.968194:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6176:x1869752785967360:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135427.968306:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6176:x1869752785967360:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 112us (323us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135427.968313:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 250 00010000:00010000:3.0:1783135428.462552:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135429.489781:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783135429.677229:0:10403:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea1430910 20000000:00000080:0.0:1783135429.677346:0:10403:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac5437d5400 uarg=0000000000000000 20000000:01000000:0.0:1783135429.677400:0:10403:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783135429.677407:0:10403:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783135429.677412:0:10403:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783135429.678788:0:10404:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1783135429.678950:0:10403:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1783135429.687355:0:10403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1783135429.687395:0:10403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1783135429.687413:0:10403:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1783135429.687431:0:10403:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783135429.687451:0:10403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.687469:0:10403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c51bc00/0xf7de4ef628edf6eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf6e4 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.687478:0:10403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edf6f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf6f2 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.687485:0:10403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edf74d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf746 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.687490:0:10403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf873 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edf86c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.687531:0:10403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf98b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ade expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.687549:0:10403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.687592:0:10403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf98b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ade expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.687611:0:10403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf98b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ade expref: 9 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135429.687637:0:10403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1869752809096960:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135429.688021:0:10403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf86c expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.688031:0:10403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf873 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf86c expref: 23 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135429.688041:0:10403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1869752809097088:0@lo:104: 00000100:00100000:0.0:1783135429.688081:0:10403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135429.688902:0:10403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edf74d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf746 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.688914:0:10403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edf74d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf746 expref: 23 pid: 6515 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135429.688926:0:10403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1869752809097216:0@lo:104: 00000100:00100000:0.0:1783135429.688977:0:10403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135429.690229:0:10403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edf6f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf6f2 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.690246:0:10403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edf6f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf6f2 expref: 23 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135429.690272:0:10403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1869752809097344:0@lo:104: 00010000:00010000:0.0:1783135429.690513:0:10403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c51bc00/0xf7de4ef628edf6eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edf6e4 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.690523:0:10403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c51bc00/0xf7de4ef628edf6eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edf6e4 expref: 23 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135429.690542:0:10403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1869752809097472:0@lo:104: 00000100:00100000:0.0:1783135429.690564:0:10403:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6412edcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135429.690918:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783135429.690945:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135429.691152:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135429.691213:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809097088 00000100:00100000:1.0:1783135429.691221:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809097088 00000100:00100000:1.0:1783135429.691388:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809097216 00000100:00100000:1.0:1783135429.691392:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809097216 00000100:00100000:1.0:1783135429.691405:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809097344 00000100:00100000:1.0:1783135429.691407:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809097344 00000100:00100000:1.0:1783135429.691421:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135429.691429:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:10403:x1869752809097088:12345-0@lo:104: 00010000:00010000:1.0:1783135429.691443:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.691780:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135429.691787:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:10403:x1869752809097088:12345-0@lo:104: Request processed in 358us (3706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135429.691794:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135429.691814:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135429.691835:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54326c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:10403:x1869752809097216:12345-0@lo:104: 00010000:00010000:1.0:1783135429.691844:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.691875:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135429.691883:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1783135429.691888:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135429.691888:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54326c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:10403:x1869752809097216:12345-0@lo:104: Request processed in 54us (2911us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135429.691894:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1783135429.691896:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b800 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135429.691900:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.691909:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135429.691916:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135429.691921:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1783135429.691923:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135429.691929:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:10403:x1869752809097344:12345-0@lo:104: 00010000:00010000:1.0:1783135429.691936:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.691951:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.691964:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1783135429.691967:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783135429.691968:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:10403:x1869752809097344:12345-0@lo:104: Request processed in 40us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135429.691973:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1783135429.691989:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.691989:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135429.691994:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.691997:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b800/0xf7de4ef628edf86c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf873 expref: -99 pid: 9518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.692000:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031c00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135429.692003:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.692010:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135429.692012:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.692018:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526e00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135429.692021:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.692027:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135429.692033:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135429.692038:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783135429.692052:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.692057:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135429.692062:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.692069:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628edf6f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6f9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.692085:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135429.692108:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135429.692110:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135429.692123:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809097472 00000100:00100000:2.0:1783135429.692128:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809097472 00000100:00100000:3.0:1783135429.692130:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809097600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135429.692148:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783135429.692154:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:10403:x1869752809097472:12345-0@lo:104: 00000100:00100000:3.0:1783135429.692161:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135429.692169:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a000/0xf7de4ef628edf6e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135429.692192:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135429.692197:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809097728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135429.692203:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135429.692207:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:10403:x1869752809097472:12345-0@lo:104: Request processed in 54us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135429.692214:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135429.692216:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135429.692234:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809097600 00000100:00100000:2.0:1783135429.692237:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809097600 00010000:00010000:2.0:1783135429.692380:0:10345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf873 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf86c expref: 24 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135429.692408:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809097728 00000100:00100000:2.0:1783135429.692412:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809097728 00010000:00010000:2.0:1783135429.692423:0:10345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edf6f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf6f2 expref: 25 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135429.692442:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783135429.692448:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:3648:x1869752809097600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135429.692458:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135429.692462:0:10345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf873 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf86c expref: 25 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.692471:0:10345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf873 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf86c expref: 25 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135429.692477:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135429.692484:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:3648:x1869752809097728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135429.692487:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135429.692491:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135429.692495:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edf6f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf6f2 expref: 25 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.692515:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edf6f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf6f2 expref: 25 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135429.692524:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:3648:x1869752809097600:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (362us total) trans 0 rc 0/0 00010000:00010000:3.0:1783135429.692525:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135429.692530:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135429.692545:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:3648:x1869752809097728:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (328us total) trans 0 rc 0/0 00010000:00010000:0.0:1783135429.692827:0:10403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edf873 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf86c expref: 25 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135429.692840:0:10403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1869752809097088:0@lo:104: 00000100:00100000:0.0:1783135429.692863:0:10403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1869752809097216:0@lo:104: 00010000:00010000:0.0:1783135429.692871:0:10403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edf6f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf6f2 expref: 24 pid: 6516 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135429.692879:0:10403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1869752809097344:0@lo:104: 00000100:00100000:0.0:1783135429.692887:0:10403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1869752809097472:0@lo:104: 00010000:00010000:1.0:1783135429.692941:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135429.692948:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135429.692959:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135429.693029:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.693036:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135429.693054:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.693060:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac640031c00/0xf7de4ef628edf746 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf74d expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.693070:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135429.693074:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a000/0xf7de4ef628edf6e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.693080:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a000 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135429.693083:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a000/0xf7de4ef628edf6e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.693103:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a000/0xf7de4ef628edf6e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135429.693109:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a000/0xf7de4ef628edf6e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135429.693113:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135429.693210:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135429.693231:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809097728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135429.693239:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809097600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135429.693275:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809097856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135429.693319:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135429.693383:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809097856 00000100:00100000:2.0:1783135429.693387:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809097856 00010000:00010000:2.0:1783135429.693402:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edf74d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf746 expref: 23 pid: 6515 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.694129:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a000/0xf7de4ef628edf6e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.694140:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135429.694167:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a000/0xf7de4ef628edf6e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.694174:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51a000/0xf7de4ef628edf6e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edf6eb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135429.694190:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135429.694192:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135429.694194:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135429.694201:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135429.694211:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809097984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135429.694263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135429.696574:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135429.696608:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809097984 00000100:00100000:3.0:1783135429.696616:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809097984 00000100:00100000:0.0:1783135429.696904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135429.696940:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135429.696977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135429.696993:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135429.697031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135429.697132:0:10403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10403:1869752809096960:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135429.697170:0:10403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.697488:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c51bc00/0xf7de4ef628edf6eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf6e4 expref: 23 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135429.697532:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135429.697553:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac64875f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:3647:x1869752809097984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135429.697568:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135429.697573:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c51bc00/0xf7de4ef628edf6eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf6e4 expref: 23 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.697582:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c51bc00/0xf7de4ef628edf6eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf6e4 expref: 23 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.697597:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51bc00/0xf7de4ef628edf6eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf6e4 expref: 23 pid: 6517 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135429.697609:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135429.697735:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785967488 00000100:00100000:1.0:1783135429.697741:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785967488 00000100:00100000:1.0:1783135429.697774:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 251 00000100:00100000:1.0:1783135429.697780:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2400:x1869752785967488:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135429.697840:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2400:x1869752785967488:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 59us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135429.697847:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 251 00000100:00100000:3.0:1783135429.698104:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac64875f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:3647:x1869752809097984:12345-0@lo:103:ldlm_bl.0 Request processed in 532us (3820us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135429.698112:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135429.698138:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785967744 00000100:00100000:3.0:1783135429.698144:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785967744 00000100:00100000:3.0:1783135429.698177:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785967616 00000100:00100000:3.0:1783135429.698180:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785967616 00000100:00100000:3.0:1783135429.698200:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:3.0:1783135429.698207:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785967744:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135429.698237:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785967744:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 31us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135429.698243:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:3.0:1783135429.698766:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:3.0:1783135429.698775:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785967616:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135429.698807:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785967616:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 34us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135429.698827:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:3.0:1783135429.698880:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00080000:3.0:1783135429.698993:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135429.698998:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135429.699133:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785968128 00000100:00100000:0.0:1783135429.699138:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785968128 00010000:00010000:0.0:1783135429.699161:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf98b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ade expref: 10 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135429.699191:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:0.0:1783135429.699198:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2401:x1869752785968128:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135429.699207:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135429.699212:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf98b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ade expref: 10 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.699222:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf98b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ade expref: 10 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.699236:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650989000/0xf7de4ef628edf98b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ade expref: 10 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135429.699261:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135429.699409:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:2401:x1869752785968128:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 211us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135429.699417:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:0.0:1783135429.700217:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785968000 00000100:00100000:0.0:1783135429.700239:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785968000 00000100:00100000:1.0:1783135429.700483:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809097984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135429.701435:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785967872 00000100:00100000:1.0:1783135429.701443:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785967872 00000100:00100000:2.0:1783135429.702416:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783135429.702435:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3646:x1869752809097856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135429.702455:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135429.702464:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edf74d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edf746 expref: 21 pid: 6515 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702480:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edf74d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edf746 expref: 21 pid: 6515 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702497:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edf74d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edf746 expref: 21 pid: 6515 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702528:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702548:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702566:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702587:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702594:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702600:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702606:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135429.702610:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702626:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702645:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702656:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135429.702726:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:3646:x1869752809097856:12345-0@lo:103:ldlm_bl.0 Request processed in 299us (9406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135429.702734:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783135429.702866:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809097856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135429.702911:0:10403:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702919:0:10403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135429.702936:0:10403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfa4f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135429.704163:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1783135429.704183:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785968000:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135429.706732:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785968000:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 2543us (9740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135429.706751:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:1.0:1783135429.707465:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:1.0:1783135429.707480:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785967872:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135429.707731:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785967872:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 255us (10698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135429.707739:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00080000:3.0:1783135429.718740:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135429.718751:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135429.998335:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809098112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135429.998428:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135429.998757:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809098240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135429.998794:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135429.998830:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809098240 00000100:00100000:3.0:1783135429.998837:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809098240 00000100:00100000:3.0:1783135429.998891:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135429.998901:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809098240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135429.998943:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135429.998994:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809098240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135429.999002:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135429.999054:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809098240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135430.000415:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809098624:0@lo:400:kworker.0 00000100:00100000:0.0:1783135430.000473:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135430.000517:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809099136:0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.000604:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809098112 00000100:00100000:1.0:1783135430.000612:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809098112 00000100:00100000:1.0:1783135430.000664:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135430.000674:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809098112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135430.000714:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135430.000754:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809098112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135430.000761:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135430.000782:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809098496:0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.000809:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135430.000827:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809099008:0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.000849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135430.000865:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809099520:0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.000883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135430.000910:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783135430.000917:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809098368:0@lo:400:kworker.0 00000100:00100000:0.0:1783135430.000922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135430.000937:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135430.000951:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809098880:0@lo:400:kworker.0 00010000:00080000:0.0:1783135430.000953:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b0000 x1869752809098112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135430.000967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135430.000971:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809098112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135430.000980:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809099392:0@lo:400:kworker.0 00000100:00100000:0.0:1783135430.000985:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783135430.000990:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809098752:0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.000996:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135430.001007:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135430.001015:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809099264:0@lo:400:kworker.0 00000100:00100000:0.0:1783135430.001032:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135430.001055:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809099008 00000100:00100000:0.0:1783135430.001058:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809099008 00000100:00100000:0.0:1783135430.001083:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809099520 00000100:00100000:0.0:1783135430.001107:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809099520 00000100:00100000:0.0:1783135430.001121:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809099136 00000100:00100000:0.0:1783135430.001123:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809099136 00000100:00100000:0.0:1783135430.001136:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135430.001143:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809099008:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783135430.001156:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135430.001160:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135430.001174:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809098496 00000100:00100000:1.0:1783135430.001184:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809098496 00000100:00100000:0.0:1783135430.001184:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809099008:12345-0@lo:400:kworker.0 Request processed in 42us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135430.001191:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135430.001200:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809098368 00000100:00100000:0.0:1783135430.001202:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783135430.001207:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809099520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.001208:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809098368 00000100:00100000:1.0:1783135430.001221:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809098880 00000100:00100000:1.0:1783135430.001223:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809098880 00000100:00100000:0.0:1783135430.001231:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809099520:12345-0@lo:400:kworker.0 Request processed in 23us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135430.001236:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135430.001240:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809099392 00000100:00100000:1.0:1783135430.001242:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809099392 00000100:00100000:0.0:1783135430.001245:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783135430.001250:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809099136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.001252:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809098752 00000100:00100000:1.0:1783135430.001254:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809098752 00000100:00100000:1.0:1783135430.001264:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809099264 00000100:00100000:1.0:1783135430.001266:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809099264 00000100:00100000:0.0:1783135430.001273:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809099136:12345-0@lo:400:kworker.0 Request processed in 23us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135430.001279:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135430.001279:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135430.001283:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809098496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.001311:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809098496:12345-0@lo:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135430.001316:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783135430.001327:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783135430.001333:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809098368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.001357:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809098368:12345-0@lo:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135430.001363:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783135430.001372:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783135430.001378:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809098880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135430.001395:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809099776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135430.001403:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809098880:12345-0@lo:400:kworker.0 Request processed in 25us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135430.001408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783135430.001419:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783135430.001422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135430.001424:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809099392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135430.001447:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135430.001448:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809099392:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135430.001452:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809099648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135430.001461:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783135430.001469:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135430.001473:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783135430.001478:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809098752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135430.001491:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809099776 00000100:00100000:3.0:1783135430.001494:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809099776 00000100:00100000:1.0:1783135430.001516:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809098752:12345-0@lo:400:kworker.0 Request processed in 37us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135430.001521:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783135430.001522:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809099648 00000100:00100000:3.0:1783135430.001524:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809099648 00000100:00100000:1.0:1783135430.001532:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783135430.001537:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809099264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135430.001554:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135430.001559:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809099776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135430.001570:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135430.001573:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809099264:12345-0@lo:400:kworker.0 Request processed in 37us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135430.001579:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783135430.001597:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809099776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135430.001602:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135430.001614:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135430.001619:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809099648:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783135430.001619:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135430.001622:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:3.0:1783135430.001632:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135430.001640:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809098368:0@lo:400:kworker.0 00010000:00080000:1.0:1783135430.001651:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a5aa00 x1869752809098880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135430.001655:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809099648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135430.001660:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135430.001661:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809098880:0@lo:400:kworker.0 00010000:00080000:1.0:1783135430.001669:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a59f80 x1869752809099392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135430.001675:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809098624 00000100:00100000:1.0:1783135430.001677:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809099392:0@lo:400:kworker.0 00000100:00100000:3.0:1783135430.001678:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809098624 00000100:00100000:1.0:1783135430.001687:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809098496:0@lo:400:kworker.0 00010000:00080000:1.0:1783135430.001696:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a59500 x1869752809099008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135430.001698:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783135430.001703:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809098624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.001714:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809099008:0@lo:400:kworker.0 00010000:00080000:1.0:1783135430.001725:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a59880 x1869752809099520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135430.001730:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809098624:12345-0@lo:400:kworker.0 Request processed in 27us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135430.001733:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809099520:0@lo:400:kworker.0 00000100:00100000:3.0:1783135430.001736:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783135430.001753:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00080000:3.0:1783135430.001758:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84fb80 x1869752809099648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135430.001758:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809099904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135430.001769:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809099648:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1783135430.001778:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84dc00 x1869752809099776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135430.001778:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135430.001788:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809099776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135430.001808:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809099904 00000100:00100000:3.0:1783135430.001811:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809099904 00000100:00100000:3.0:1783135430.001823:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135430.001827:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809099904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135430.001835:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135430.001863:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809099904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135430.001868:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1783135430.001888:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84f480 x1869752809099904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135430.001898:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809099904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135430.001936:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809098752:0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.001946:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809099264:0@lo:400:kworker.0 00000100:00100000:1.0:1783135430.001955:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809098624:0@lo:400:kworker.0 00010000:00080000:1.0:1783135430.001962:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a58380 x1869752809099136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135430.001970:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809099136:0@lo:400:kworker.0 00010000:00010000:1.0:1783135430.510446:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783135431.345979:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135431.345991:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac67e2d9800 from 4 10000000:01000000:3.0:1783135431.345997:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135431.349332:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135431.349358:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135431.349377:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135431.349423:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.350995:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135431.351083:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135431.352154:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809100032 00000100:00100000:1.0:1783135431.352170:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809100032 00000100:00100000:1.0:1783135431.352241:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783135431.352253:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809100032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135431.352277:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135431.352304:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51a400/0xf7de4ef628edfa5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfa56 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135431.352340:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51a400/0xf7de4ef628edfa5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfa56 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135431.352364:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51a400/0xf7de4ef628edfa5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa56 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135431.352376:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a400, rc 0) 00000100:00100000:1.0:1783135431.352461:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809100032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135431.352483:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1783135431.353794:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135431.353835:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135431.353849:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135431.354185:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.354258:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135431.354301:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135431.354432:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809100160 00000100:00100000:1.0:1783135431.354439:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809100160 00000100:00100000:1.0:1783135431.354512:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783135431.354523:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809100160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135431.354708:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809100160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135431.354718:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783135431.355255:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.355310:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.355364:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135431.355393:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135431.355408:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809100288 00000100:00100000:3.0:1783135431.355416:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809100288 00000100:00100000:3.0:1783135431.355457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783135431.355465:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809100288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.356234:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809100288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 765us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135431.356246:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1783135431.368780:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.372979:0:10439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10439:1869752809100416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135431.373304:0:10439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135431.373422:0:10439:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135431.375957:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809100416 00000100:00100000:0.0:1783135431.375981:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809100416 00000100:00100000:2.0:1783135431.376158:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783135431.376170:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:10439:x1869752809100416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135431.376400:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:10439:x1869752809100416:12345-0@lo:502:llog_process_th.0 Request processed in 231us (3096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135431.376410:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783135431.376817:0:10439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10439:1869752809100416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135431.376863:0:10439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135431.376877:0:10439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135431.376890:0:10439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783135431.376898:0:10439:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac67e2d9800 00000020:00000080:0.0:1783135431.376901:0:10439:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783135431.377004:0:10439:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10439:1869752809100544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135431.377073:0:10439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135431.377138:0:10439:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c6b5600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135431.377197:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809100544 00000100:00100000:1.0:1783135431.377205:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809100544 00000100:00100000:1.0:1783135431.377248:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1783135431.377257:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:10439:x1869752809100544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135431.377351:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:10439:x1869752809100544:12345-0@lo:502:llog_process_th.0 Request processed in 95us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135431.377357:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783135431.377609:0:10439:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10439:1869752809100544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135431.377635:0:10439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135431.377646:0:10439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135431.377648:0:10439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783135431.377652:0:10439:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783135431.379638:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783135431.379685:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135431.379700:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.379726:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135431.379739:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135431.379742:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac67c2fd800 from 4 10000000:01000000:0.0:1783135431.379745:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135431.379793:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.379802:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.379814:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135431.379845:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.379943:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135431.380005:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c6b5600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135431.380200:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809100672 00000100:00100000:1.0:1783135431.380209:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809100672 00000100:00100000:1.0:1783135431.380273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1783135431.380285:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809100672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135431.380323:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135431.380339:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51a200/0xf7de4ef628edfa6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfa64 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135431.380369:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51a200/0xf7de4ef628edfa6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfa64 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135431.380381:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51a200/0xf7de4ef628edfa6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa64 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135431.380391:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a200, rc 0) 00000100:00100000:1.0:1783135431.380438:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809100672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135431.380445:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1783135431.380773:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135431.380792:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.380803:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135431.381187:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.381233:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135431.381310:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c6b5600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135431.385274:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809100800 00000100:00100000:1.0:1783135431.385297:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809100800 00000100:00100000:1.0:1783135431.385384:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1783135431.385399:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809100800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135431.385824:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809100800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 427us (4587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135431.385834:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1783135431.392860:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.399246:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.399367:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135431.399435:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135431.404291:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809100928 00000100:00100000:0.0:1783135431.404314:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809100928 00000100:00100000:0.0:1783135431.404390:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1783135431.404402:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809100928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.404712:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809100928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 312us (5344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135431.404721:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783135431.404875:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809100928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.405964:0:10443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10443:1869752809101056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135431.406244:0:10443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135431.406301:0:10443:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135431.406351:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809101056 00000100:00100000:0.0:1783135431.406359:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809101056 00000100:00100000:0.0:1783135431.406405:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783135431.406416:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:10443:x1869752809101056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135431.406651:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:10443:x1869752809101056:12345-0@lo:502:llog_process_th.0 Request processed in 236us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135431.406659:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783135431.406996:0:10443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10443:1869752809101056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135431.407030:0:10443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135431.407175:0:10443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135431.407178:0:10443:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783135431.407188:0:10443:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac67c2fd800 00000020:00000080:3.0:1783135431.407191:0:10443:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783135431.408374:0:10443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10443:1869752809101184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135431.408467:0:10443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135431.408546:0:10443:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135431.414027:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809101184 00000100:00100000:0.0:1783135431.414181:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809101184 00000100:00100000:0.0:1783135431.414255:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1783135431.414268:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:10443:x1869752809101184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135431.414501:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:10443:x1869752809101184:12345-0@lo:502:llog_process_th.0 Request processed in 235us (6032us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135431.414788:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1783135431.414964:0:10443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10443:1869752809101184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135431.415009:0:10443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135431.415019:0:10443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135431.415022:0:10443:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783135431.415027:0:10443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783135431.415310:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783135431.415338:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135431.415350:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.415364:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135431.415377:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135431.415381:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac6743ed800 from 4 10000000:01000000:0.0:1783135431.415384:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135431.415425:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.415435:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.415445:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135431.415485:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809101312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.415658:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135431.415697:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809101312 00000100:00100000:0.0:1783135431.415714:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809101312 00000100:00100000:0.0:1783135431.415755:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783135431.415764:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809101312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135431.415778:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135431.415793:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65d400/0xf7de4ef628edfa79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfa72 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.415821:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65d400/0xf7de4ef628edfa79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfa72 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.415832:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65d400/0xf7de4ef628edfa79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa72 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.415842:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d400, rc 0) 00000100:00100000:0.0:1783135431.415874:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809101312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135431.415893:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783135431.415939:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135431.415955:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809101312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135431.415968:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.415978:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135431.416215:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809101440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.416245:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135431.416266:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809101440 00000100:00100000:0.0:1783135431.416278:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809101440 00000100:00100000:0.0:1783135431.416302:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783135431.416309:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809101440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.416428:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809101440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135431.416435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783135431.416462:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135431.416489:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809101440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.418995:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809101568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.419671:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135431.419738:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809101568 00000100:00100000:0.0:1783135431.419749:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809101568 00000100:00100000:0.0:1783135431.419806:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783135431.419815:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809101568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.423548:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809101568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3716us (3863us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135431.423569:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783135431.423681:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135431.423717:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809101568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.426337:0:10445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10445:1869752809101696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135431.426457:0:10445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135431.426652:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809101696 00000100:00100000:3.0:1783135431.426662:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809101696 00000100:00100000:3.0:1783135431.426757:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783135431.426770:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:10445:x1869752809101696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135431.426937:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:10445:x1869752809101696:12345-0@lo:502:llog_process_th.0 Request processed in 169us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135431.426945:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783135431.440260:0:10445:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d000 going to sleep for 11 seconds 00000100:00100000:3.0:1783135431.440320:0:10445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10445:1869752809101696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135431.440376:0:10445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135431.440398:0:10445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135431.440401:0:10445:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783135431.440409:0:10445:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac6743ed800 00000020:00000080:3.0:1783135431.440412:0:10445:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783135431.442679:0:10445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10445:1869752809101824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135431.442793:0:10445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135431.442868:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809101824 00000100:00100000:3.0:1783135431.442877:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809101824 00000100:00100000:3.0:1783135431.444747:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783135431.444762:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:10445:x1869752809101824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135431.447209:0:10445:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d000 going to sleep for 11 seconds 00000100:00100000:2.0:1783135431.447262:0:10445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10445:1869752809101824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783135431.447316:0:10445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135431.447331:0:10445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135431.447333:0:10445:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783135431.447340:0:10445:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:3.0:1783135431.447643:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:10445:x1869752809101824:12345-0@lo:502:llog_process_th.0 Request processed in 2880us (4848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135431.447658:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000020:01000000:0.0:1783135431.448412:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783135431.448452:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135431.448479:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.448494:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135431.448992:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135431.448996:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac64382e000 from 4 10000000:01000000:0.0:1783135431.449000:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135431.449051:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.449060:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.449073:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135431.449138:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809101952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.449231:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135431.449292:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135431.450844:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809101952 00000100:00100000:3.0:1783135431.450864:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809101952 00000100:00100000:3.0:1783135431.453623:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783135431.453644:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809101952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135431.453681:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135431.453706:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c526e00/0xf7de4ef628edfa87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfa80 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135431.453745:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c526e00/0xf7de4ef628edfa87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfa80 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135431.453758:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c526e00/0xf7de4ef628edfa87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa80 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135431.453769:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526e00, rc 0) 00000100:00100000:3.0:1783135431.453878:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809101952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (4647us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135431.454209:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783135431.457296:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809101952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135431.457335:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135431.457349:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135431.457467:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809102080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.457558:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135431.457616:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135431.457643:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809102080 00000100:00100000:3.0:1783135431.457650:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809102080 00000100:00100000:3.0:1783135431.457709:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783135431.457719:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809102080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.459197:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809102080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.459278:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809102208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.459370:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135431.459416:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135431.459439:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809102208 00000100:00100000:0.0:1783135431.459445:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809102208 00000100:00100000:0.0:1783135431.459508:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783135431.459519:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:6519:x1869752809102208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.459652:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:6519:x1869752809102208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135431.459661:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783135431.459727:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809102208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135431.460150:0:10448:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a58e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10448:1869752809102336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135431.460185:0:10448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135431.460206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809102336 00000100:00100000:0.0:1783135431.460210:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809102336 00000100:00100000:0.0:1783135431.460228:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783135431.460233:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:10448:x1869752809102336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135431.460311:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:10448:x1869752809102336:12345-0@lo:502:llog_process_th.0 Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135431.460318:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783135431.460353:0:10448:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135431.460366:0:10448:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a58e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10448:1869752809102336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135431.460389:0:10448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135431.460400:0:10448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135431.460402:0:10448:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783135431.460410:0:10448:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac64382e000 00000020:00000080:0.0:1783135431.460413:0:10448:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783135431.460506:0:10448:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a58e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10448:1869752809102464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135431.460540:0:10448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135431.460556:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809102464 00000100:00100000:0.0:1783135431.460560:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809102464 00000100:00100000:0.0:1783135431.460573:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1783135431.460579:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:10448:x1869752809102464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135431.460638:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:10448:x1869752809102464:12345-0@lo:502:llog_process_th.0 Request processed in 59us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135431.460645:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1783135431.460674:0:10448:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bcea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135431.460685:0:10448:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a58e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:10448:1869752809102464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135431.460701:0:10448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135431.460705:0:10448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135431.460706:0:10448:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783135431.460710:0:10448:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783135431.460775:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783135431.460803:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135431.460813:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135431.460826:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135431.461375:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809102080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3652us (3813us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135431.461386:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783135431.479253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135431.479460:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785968256 00000100:00100000:3.0:1783135431.479484:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785968256 00000100:00100000:3.0:1783135431.480114:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 272 00000100:00100000:3.0:1783135431.480131:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:6176:x1869752785968256:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135431.480155:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135431.480177:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfa8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140b24 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135431.480227:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfa8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b24 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135431.480240:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfa8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b24 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135431.480251:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526a00, rc 0) 00000100:00100000:3.0:1783135431.480335:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6176:x1869752785968256:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 208us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135431.480343:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 272 00000100:00100000:2.0:1783135431.501770:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135431.501980:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785968384 00000100:00100000:2.0:1783135431.501993:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785968384 00000100:00100000:2.0:1783135431.502219:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 273 00000100:00100000:2.0:1783135431.502233:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6176:x1869752785968384:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135431.502435:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6176:x1869752785968384:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 205us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135431.502457:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 273 00000100:00100000:3.0:1783135431.506764:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135431.506818:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785968512 00000100:00100000:3.0:1783135431.506831:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785968512 00000100:00100000:3.0:1783135431.508186:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 274 00000100:00100000:3.0:1783135431.508208:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6176:x1869752785968512:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135431.508417:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6176:x1869752785968512:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 216us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135431.508427:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 274 00000100:00100000:3.0:1783135431.514721:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135431.514792:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785968640 00000100:00100000:3.0:1783135431.514804:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785968640 00000100:00100000:3.0:1783135431.514866:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 275 00000100:00100000:3.0:1783135431.514890:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6720:x1869752785968640:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135431.515178:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6720:x1869752785968640:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 301us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135431.515197:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 275 00000100:00100000:3.0:1783135431.527846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135431.539360:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785968768 00000100:00100000:2.0:1783135431.539388:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785968768 00010000:00010000:2.0:1783135431.539450:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135431.540257:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 276 00000100:00100000:2.0:1783135431.540271:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6720:x1869752785968768:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135431.540508:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:6720:x1869752785968768:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 229us (12662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135431.540518:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 276 00010000:00010000:1.0:1783135432.558635:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135433.084524:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809102592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135433.084637:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135433.084941:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809102592 00000100:00100000:3.0:1783135433.084952:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809102592 00000100:00100000:3.0:1783135433.085019:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783135433.085031:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809102592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135433.085082:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783135433.085171:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809102592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135433.085179:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783135433.085294:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809102592:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135433.584823:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135434.616572:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135434.812867:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135434.812913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135434.812942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135434.812963:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135434.812986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135434.813016:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785969408 00000100:00100000:0.0:1783135434.813028:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785969408 00000100:00100000:0.0:1783135434.813111:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785969280 00000100:00100000:0.0:1783135434.813113:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785969280 00000100:00100000:0.0:1783135434.813135:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:0.0:1783135434.813146:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785969408:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135434.813233:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785969408:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 89us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135434.813267:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:0.0:1783135434.813286:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:0.0:1783135434.813292:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785969280:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135434.813317:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785969280:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135434.813322:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:1.0:1783135434.813634:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785969152 00000100:00100000:1.0:1783135434.813639:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785969152 00000100:00100000:1.0:1783135434.813673:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785969024 00000100:00100000:1.0:1783135434.813675:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785969024 00000100:00100000:1.0:1783135434.813697:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:1.0:1783135434.813710:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785969152:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135434.813747:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785969152:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 39us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135434.813754:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:1.0:1783135434.813766:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:1.0:1783135434.813771:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785969024:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135434.813790:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785969024:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 19us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135434.813796:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00080000:1.0:1783135434.813814:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135434.813819:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135434.813822:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135434.813825:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135434.814042:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785968896 00000100:00100000:3.0:1783135434.814047:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785968896 00000100:00100000:3.0:1783135434.814105:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 277 00000100:00100000:3.0:1783135434.814113:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2400:x1869752785968896:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135434.814140:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2400:x1869752785968896:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135434.814146:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 277 00000100:00100000:2.0:1783135435.118439:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135435.118471:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809102720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135435.118578:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135435.118680:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809102720 00000100:00100000:2.0:1783135435.118690:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809102720 00000100:00100000:1.0:1783135435.118944:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809102848:0@lo:400:kworker.0 00000100:00100000:1.0:1783135435.118990:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135435.119190:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135435.119202:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809102720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135435.119271:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135435.122914:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809103360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135435.123178:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.125081:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809102976:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.125204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.125262:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809103488:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.125304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.125331:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809104000:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.125386:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.125428:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783135435.125436:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809103104:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.125459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.125469:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809103616:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.125490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.125509:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809104128:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.125530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.125582:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809103360 00000100:00100000:0.0:1783135435.125591:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809103360 00000100:00100000:0.0:1783135435.125643:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809103488 00000100:00100000:0.0:1783135435.126563:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809103488 00000100:00100000:0.0:1783135435.126602:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809103104 00000100:00100000:0.0:1783135435.126616:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809103104 00000100:00100000:0.0:1783135435.126638:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783135435.126648:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1869752809103360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135435.126712:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783135435.126786:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1869752809103360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (3609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.126793:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783135435.126811:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783135435.126817:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809103488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.126861:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809103488:12345-0@lo:400:kworker.0 Request processed in 44us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.126867:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783135435.126877:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135435.126882:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809103104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.126906:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809103104:12345-0@lo:400:kworker.0 Request processed in 24us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.126911:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135435.126942:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809104000 00000100:00100000:0.0:1783135435.126945:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809104000 00000100:00100000:0.0:1783135435.126979:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135435.126986:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809104000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.127014:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809104000:12345-0@lo:400:kworker.0 Request processed in 30us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.127020:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135435.127039:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809102976 00000100:00100000:0.0:1783135435.127042:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809102976 00000100:00100000:0.0:1783135435.127085:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809103616 00000100:00100000:0.0:1783135435.127107:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809103616 00000100:00100000:0.0:1783135435.127120:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809104128 00000100:00100000:0.0:1783135435.127123:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809104128 00000100:00100000:0.0:1783135435.127137:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783135435.127143:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809102976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.127177:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809102976:12345-0@lo:400:kworker.0 Request processed in 34us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.127183:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783135435.127192:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783135435.127198:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809103616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.127223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809103616:12345-0@lo:400:kworker.0 Request processed in 25us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.127229:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783135435.127239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783135435.127245:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809104128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.127268:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809104128:12345-0@lo:400:kworker.0 Request processed in 24us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.127274:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783135435.127322:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809103104:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.127338:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809103616:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.127350:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809104128:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.127362:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809102976:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.127371:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809103488:0@lo:400:kworker.0 00010000:00080000:0.0:1783135435.127410:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a58700 x1869752809104000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135435.127423:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809104000:0@lo:400:kworker.0 00000100:00080000:0.0:1783135435.127593:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135435.127600:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135435.127602:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135435.127616:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809104640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135435.127656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.127684:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135435.127690:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809104512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135435.127712:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.127734:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1783135435.127743:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1783135435.127919:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809103232:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.127949:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.127968:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809103744:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.127991:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.128003:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809104256:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.128031:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.128046:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783135435.128052:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809103872:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.128072:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.128138:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809104384:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.128159:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.128184:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809103232 00000100:00100000:0.0:1783135435.128198:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809103232 00000100:00100000:0.0:1783135435.128228:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809103744 00000100:00100000:0.0:1783135435.128231:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809103744 00000100:00100000:0.0:1783135435.128251:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809104256 00000100:00100000:0.0:1783135435.128254:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809104256 00000100:00100000:0.0:1783135435.128271:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783135435.128278:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809103232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.128327:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809103232:12345-0@lo:400:kworker.0 Request processed in 49us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.128335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783135435.128349:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783135435.128355:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809103744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.128382:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809103744:12345-0@lo:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.128388:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783135435.128398:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783135435.128419:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809104256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.128446:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809104256:12345-0@lo:400:kworker.0 Request processed in 28us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.128452:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1783135435.128467:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135435.128499:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809103232:0@lo:400:kworker.0 00010000:00080000:0.0:1783135435.128512:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a59f80 x1869752809103744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135435.128522:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809103744:0@lo:400:kworker.0 00010000:00080000:0.0:1783135435.128533:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b3b80 x1869752809104256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135435.128549:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809104256:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.128600:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809104640 00000100:00100000:0.0:1783135435.128604:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809104640 00000100:00100000:0.0:1783135435.128631:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1783135435.128638:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809104512 00000100:00100000:0.0:1783135435.128641:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809104512 00000100:00080000:0.0:1783135435.128658:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135435.128661:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135435.128758:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783135435.128766:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809104640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783135435.128796:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135435.128841:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809104640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.128848:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1783135435.128875:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5437a4a80 x1869752809104640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135435.128893:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809104640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135435.128913:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783135435.128920:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809104512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135435.128931:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135435.128966:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809104512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.128972:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1783135435.128994:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5437a4000 x1869752809104512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135435.129022:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809104512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135435.129161:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809104768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135435.129193:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135435.129221:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809104768 00000100:00100000:0.0:1783135435.129226:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809104768 00000100:00100000:0.0:1783135435.129247:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783135435.129253:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809104768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135435.129279:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135435.129309:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809104768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.129315:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1783135435.129339:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5437a4000 x1869752809104768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135435.129352:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809104768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135435.129388:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809103872 00000100:00100000:0.0:1783135435.129392:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809103872 00000100:00100000:0.0:1783135435.130936:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809104384 00000100:00100000:0.0:1783135435.130951:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809104384 00000100:00100000:0.0:1783135435.130993:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783135435.131003:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809103872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.131115:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809103872:12345-0@lo:400:kworker.0 Request processed in 113us (3041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.131122:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783135435.131140:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783135435.131146:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809104384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.131191:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809104384:12345-0@lo:400:kworker.0 Request processed in 46us (3031us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.131197:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1783135435.131262:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a5aa00 x1869752809103872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135435.131278:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809103872:0@lo:400:kworker.0 00010000:00080000:0.0:1783135435.131292:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b2300 x1869752809104384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135435.131300:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809104384:0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.131497:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809102848 00000100:00100000:0.0:1783135435.131503:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809102848 00000100:00100000:0.0:1783135435.131555:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1783135435.131562:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809102848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135435.131600:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809102848:12345-0@lo:400:kworker.0 Request processed in 39us (12609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135435.131606:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783135435.135502:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809102720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 16286us (16908us total) trans 0 rc 0/0 00010000:00080000:1.0:1783135435.135511:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b3480 x1869752809102720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135435.135522:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783135435.135540:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809102720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135435.135591:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809103360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135435.135603:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809102848:0@lo:400:kworker.0 00010000:00010000:0.0:1783135435.632351:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135436.656610:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135437.681893:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135438.192555:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809104896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135438.192660:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135438.192955:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809104896 00000100:00100000:1.0:1783135438.192989:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809104896 00000100:00100000:1.0:1783135438.193056:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783135438.193068:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809104896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135438.193140:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135438.193205:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809104896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135438.193213:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783135438.193266:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809104896:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1783135438.521570:0:10705:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1783135438.707260:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135439.727646:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135439.942596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135439.942690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135439.942750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135439.942813:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785969792 00000100:00100000:0.0:1783135439.942830:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785969792 00000100:00100000:0.0:1783135439.942943:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785969664 00000100:00100000:0.0:1783135439.942949:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785969664 00000100:00100000:0.0:1783135439.943363:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:0.0:1783135439.943380:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785969792:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135439.943399:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785969536 00000100:00100000:1.0:1783135439.943406:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785969536 00000100:00100000:1.0:1783135439.943448:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 279 00000100:00100000:1.0:1783135439.943457:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2399:x1869752785969536:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135439.943495:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785969792:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 119us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135439.943497:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2399:x1869752785969536:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 40us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135439.943514:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 279 00000100:00100000:0.0:1783135439.943514:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:0.0:1783135439.943540:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:0.0:1783135439.943549:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785969664:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135439.943577:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785969664:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 30us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135439.943583:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:3.0:1783135439.950698:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135439.950873:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135439.950963:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785969920 00000100:00100000:3.0:1783135439.950975:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785969920 00000100:00100000:3.0:1783135439.951054:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785970048 00000100:00100000:3.0:1783135439.951058:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785970048 00000100:00100000:3.0:1783135439.951109:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:3.0:1783135439.951995:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2397:x1869752785969920:12345-192.168.204.6@tcp:9:kworker.0 00000020:00000080:3.0:1783135439.952074:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf9a0 00000100:00080000:3.0:1783135439.952116:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8ac67c62e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135439.952206:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783135439.952496:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+2:2397:x1869752785969920:12345-192.168.204.6@tcp:9:kworker.0 Request processed in 514us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135439.952511:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:3.0:1783135439.952623:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:3.0:1783135439.952635:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6752d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2397:x1869752785970048:12345-192.168.204.6@tcp:9:kworker.0 00000020:00000080:3.0:1783135439.952654:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf9a7 00000100:00080000:3.0:1783135439.952664:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8ac67c5ef800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135439.952704:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783135439.952811:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6752d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+2:2397:x1869752785970048:12345-192.168.204.6@tcp:9:kworker.0 Request processed in 178us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135439.952818:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00010000:00010000:3.0:1783135439.953548:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135439.953560:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135439.956448:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135439.956463:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135439.956469:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135439.956472:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135440.239125:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135440.239161:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809105024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135440.239289:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135440.239667:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809105024 00000100:00100000:3.0:1783135440.239678:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809105024 00000100:00100000:3.0:1783135440.239752:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783135440.239763:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809105024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135440.239812:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135440.239878:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809105024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135440.239908:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783135440.240971:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135440.241010:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809105152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135440.241077:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135440.241517:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809105152 00000100:00100000:0.0:1783135440.241524:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809105152 00000100:00100000:0.0:1783135440.241588:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783135440.241598:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809105152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135440.241630:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135440.241678:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809105152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135440.241685:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783135440.241711:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809105280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135440.241755:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135440.241774:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809105792:0@lo:400:kworker.0 00000100:00100000:0.0:1783135440.241798:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135440.241813:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809106304:0@lo:400:kworker.0 00000100:00100000:0.0:1783135440.241836:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135440.241852:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783135440.241858:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809105408:0@lo:400:kworker.0 00000100:00100000:0.0:1783135440.241886:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135440.241909:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809105920:0@lo:400:kworker.0 00000100:00100000:0.0:1783135440.241934:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135440.241949:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809106432:0@lo:400:kworker.0 00000100:00100000:0.0:1783135440.241968:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135440.242155:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809105280 00000100:00100000:2.0:1783135440.242160:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809105280 00000100:00100000:2.0:1783135440.242210:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135440.242218:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809105280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135440.242259:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135440.242295:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809105280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.242302:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135440.242337:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809106816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135440.242360:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783135440.242397:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5437a4380 x1869752809105280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135440.242420:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809105280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135440.242448:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809106816 00000100:00100000:2.0:1783135440.242451:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809106816 00000100:00100000:2.0:1783135440.242469:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135440.242475:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809106816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135440.242486:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135440.242515:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809106816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.242522:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1783135440.242544:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b0380 x1869752809106816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135440.242557:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809106816:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783135440.242607:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135440.242613:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135440.242624:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809105536:0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.242650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135440.242678:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809106048:0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.242700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135440.242716:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809106560:0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.242737:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783135440.242756:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b2d80 x1869752809105152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135440.242769:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809105152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135440.242782:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783135440.242788:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809105664:0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.242811:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135440.242822:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809106176:0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.242841:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135440.242856:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809106688:0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.242873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135440.242911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809105408 00000100:00100000:2.0:1783135440.242916:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809105408 00000100:00100000:2.0:1783135440.242943:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783135440.242950:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809105408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.242988:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809105408:12345-0@lo:400:kworker.0 Request processed in 38us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.243011:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783135440.243057:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809105408:0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.243119:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809105920 00000100:00100000:2.0:1783135440.243123:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809105920 00000100:00100000:2.0:1783135440.243152:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809106432 00000100:00100000:2.0:1783135440.243164:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809106432 00000100:00100000:2.0:1783135440.243182:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809105536 00000100:00100000:2.0:1783135440.243185:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809105536 00000100:00100000:2.0:1783135440.243196:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809106048 00000100:00100000:2.0:1783135440.243199:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809106048 00000100:00100000:2.0:1783135440.243218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809106560 00000100:00100000:2.0:1783135440.243221:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809106560 00000100:00100000:2.0:1783135440.243234:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809105664 00000100:00100000:2.0:1783135440.243237:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809105664 00000100:00100000:2.0:1783135440.243252:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783135440.243258:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809105920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.243300:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809105920:12345-0@lo:400:kworker.0 Request processed in 42us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.243319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783135440.243332:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783135440.243339:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809106432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.243367:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809106432:12345-0@lo:400:kworker.0 Request processed in 29us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.243373:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783135440.243384:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783135440.243390:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809105536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.243420:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809105536:12345-0@lo:400:kworker.0 Request processed in 30us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.243426:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783135440.243437:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783135440.243443:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809106048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.243468:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809106048:12345-0@lo:400:kworker.0 Request processed in 26us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.243483:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783135440.243496:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783135440.243502:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809106560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.243532:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809106560:12345-0@lo:400:kworker.0 Request processed in 30us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.243538:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1783135440.243548:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783135440.243554:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809105664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.243581:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809105664:12345-0@lo:400:kworker.0 Request processed in 27us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.243586:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1783135440.243607:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783135440.243610:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135440.243631:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809105664:0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.243644:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809105536:0@lo:400:kworker.0 00010000:00080000:2.0:1783135440.243656:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b2a00 x1869752809106048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135440.243666:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809106048:0@lo:400:kworker.0 00010000:00080000:2.0:1783135440.243677:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b3b80 x1869752809106560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135440.243684:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809106560:0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.243719:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809105920:0@lo:400:kworker.0 00000100:00100000:2.0:1783135440.243738:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809106432:0@lo:400:kworker.0 00000100:00100000:1.0:1783135440.244206:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809105024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135440.244554:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809106304 00000100:00100000:3.0:1783135440.244561:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809106304 00000100:00100000:3.0:1783135440.244609:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809106176 00000100:00100000:3.0:1783135440.244613:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809106176 00000100:00100000:3.0:1783135440.244628:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809106688 00000100:00100000:3.0:1783135440.244631:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809106688 00000100:00100000:3.0:1783135440.244663:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783135440.244672:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809106304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135440.244738:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809106304:12345-0@lo:400:kworker.0 Request processed in 67us (2900us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135440.244745:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783135440.244763:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135440.244769:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809106176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135440.244804:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809106176:12345-0@lo:400:kworker.0 Request processed in 35us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135440.244810:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135440.244822:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135440.244829:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809106688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135440.244859:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809106688:12345-0@lo:400:kworker.0 Request processed in 31us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135440.244865:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1783135440.244901:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135440.244919:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809105792 00000100:00100000:3.0:1783135440.244924:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809105792 00000100:00100000:3.0:1783135440.244951:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783135440.244958:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809105792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135440.245021:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809105792:12345-0@lo:400:kworker.0 Request processed in 63us (3222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135440.245029:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1783135440.245073:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b1500 x1869752809106176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135440.245119:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809106176:0@lo:400:kworker.0 00010000:00080000:3.0:1783135440.245134:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b1880 x1869752809106688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135440.245141:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809106688:0@lo:400:kworker.0 00000100:00100000:0.0:1783135440.247395:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809106944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135440.247507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135440.248123:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809106944 00000100:00100000:3.0:1783135440.248136:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809106944 00000100:00100000:2.0:1783135440.248474:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809105792:0@lo:400:kworker.0 00010000:00080000:2.0:1783135440.248499:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b2d80 x1869752809106304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135440.248511:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809106304:0@lo:400:kworker.0 00000100:00100000:3.0:1783135440.249420:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783135440.249447:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809106944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135440.249488:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135440.249594:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809106944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 158us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135440.249603:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1783135440.249735:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e2d80 x1869752809106944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135440.249760:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809106944:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783135440.756421:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135441.776936:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135442.804007:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135443.312074:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809107072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135443.312182:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135443.315672:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809107072 00000100:00100000:0.0:1783135443.315697:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809107072 00000100:00100000:0.0:1783135443.315793:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135443.315804:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809107072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135443.315858:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135443.315955:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809107072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135443.315963:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135443.316016:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809107072:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135443.827327:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135444.852968:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135444.973358:0:10949:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing yml_node 00000100:00100000:0.0:1783135445.051143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135445.051185:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135445.051240:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135445.051283:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785970432 00000100:00100000:0.0:1783135445.051294:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785970432 00000100:00100000:0.0:1783135445.051584:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785970304 00000100:00100000:0.0:1783135445.051588:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785970304 00000100:00100000:0.0:1783135445.051615:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 96 00000100:00100000:0.0:1783135445.051627:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785970432:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135445.051717:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785970432:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 93us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135445.051724:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 96 00000100:00100000:0.0:1783135445.051740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:0.0:1783135445.051745:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785970304:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135445.051769:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785970304:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135445.051775:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00080000:2.0:1783135445.052261:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135445.052266:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135445.052553:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785970176 00000100:00100000:3.0:1783135445.052561:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785970176 00000100:00100000:3.0:1783135445.058528:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 281 00000100:00100000:3.0:1783135445.058553:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2398:x1869752785970176:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135445.058652:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2398:x1869752785970176:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 109us (7517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135445.058676:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 281 00000100:00100000:0.0:1783135445.358432:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135445.358458:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809107200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135445.358535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135445.358595:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809107328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135445.358619:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135445.358650:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809107200 00000100:00100000:0.0:1783135445.358657:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809107200 00000100:00100000:3.0:1783135445.358714:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809107456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135445.358725:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809107328 00000100:00100000:0.0:1783135445.358730:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809107328 00000100:00100000:3.0:1783135445.358749:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135445.358757:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809107456 00000100:00100000:0.0:1783135445.358761:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809107456 00000100:00100000:0.0:1783135445.358786:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783135445.358801:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809107200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135445.358831:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135445.358888:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809107200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135445.359458:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135445.359472:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809107584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135445.359508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135445.361071:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783135445.361107:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809107328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135445.361145:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135445.361228:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809107328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135445.361236:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783135445.361260:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809107584 00000100:00100000:3.0:1783135445.361266:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809107584 00000100:00100000:3.0:1783135445.361294:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135445.361315:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809107456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135445.361326:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135445.361355:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809107456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135445.361361:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135445.361372:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135445.361377:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809107584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135445.361386:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135445.361413:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809107584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135445.361419:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135445.361573:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809107712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135445.361617:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783135445.362556:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b2d80 x1869752809107584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135445.362586:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809107584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135445.362628:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809107712 00000100:00100000:3.0:1783135445.362633:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809107712 00000100:00100000:3.0:1783135445.362771:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783135445.362780:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809107712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135445.362807:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135445.362861:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809107712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135445.362868:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1783135445.362906:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e2d80 x1869752809107456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135445.362920:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809107456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135445.362944:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809107712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135445.363256:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1783135445.363288:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135445.363293:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783135445.363322:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b3480 x1869752809107200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135445.363339:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809107200:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1783135445.363572:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a59500 x1869752809107328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135445.363597:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809107328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135445.365920:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809107840:0@lo:400:kworker.0 00000100:00100000:1.0:1783135445.366004:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135445.366184:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809107840 00000100:00100000:0.0:1783135445.366203:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809107840 00000100:00100000:0.0:1783135445.366264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1783135445.366275:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809107840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.367131:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809107968:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.367177:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135445.367227:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809108480:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.367249:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135445.367269:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135445.367274:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809108352:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.367308:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135445.367334:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809108224:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.367363:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135445.367382:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809108736:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.367421:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135445.367441:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783135445.367447:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809108096:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.367468:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135445.367488:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809108608:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.367508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135445.367532:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809108224 00000100:00100000:2.0:1783135445.367538:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809108224 00000100:00100000:2.0:1783135445.367579:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135445.367589:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809108224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.367646:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809108224:12345-0@lo:400:kworker.0 Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135445.367653:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135445.367954:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809108224:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.368358:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809107968 00000100:00100000:2.0:1783135445.368364:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809107968 00000100:00100000:2.0:1783135445.368386:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809108480 00000100:00100000:2.0:1783135445.368388:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809108480 00000100:00100000:2.0:1783135445.368409:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809108352 00000100:00100000:2.0:1783135445.368412:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809108352 00000100:00100000:2.0:1783135445.368425:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809108736 00000100:00100000:2.0:1783135445.368427:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809108736 00000100:00100000:2.0:1783135445.368439:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809108096 00000100:00100000:2.0:1783135445.368442:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809108096 00000100:00100000:2.0:1783135445.368452:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809108608 00000100:00100000:2.0:1783135445.368454:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809108608 00000100:00100000:2.0:1783135445.368467:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783135445.368472:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809107968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.368522:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809107968:12345-0@lo:400:kworker.0 Request processed in 49us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135445.368528:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783135445.368541:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783135445.368546:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809108480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.368585:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809108480:12345-0@lo:400:kworker.0 Request processed in 39us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135445.368591:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783135445.368603:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783135445.368609:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809108352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.368635:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809108352:12345-0@lo:400:kworker.0 Request processed in 26us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135445.368640:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783135445.368650:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783135445.368655:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809108736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.368684:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809108736:12345-0@lo:400:kworker.0 Request processed in 29us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135445.368690:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783135445.368716:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783135445.368722:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809108096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.368749:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809108096:12345-0@lo:400:kworker.0 Request processed in 28us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135445.368754:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783135445.368765:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783135445.368770:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809108608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.368794:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809108608:12345-0@lo:400:kworker.0 Request processed in 24us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135445.368800:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783135445.368843:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809108352:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.368865:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809107968:0@lo:400:kworker.0 00010000:00080000:2.0:1783135445.368875:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5437a5180 x1869752809108480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135445.368886:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809108480:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.368915:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809108096:0@lo:400:kworker.0 00000100:00100000:2.0:1783135445.368924:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809108608:0@lo:400:kworker.0 00010000:00080000:2.0:1783135445.368934:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5437a5f80 x1869752809108736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135445.368942:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809108736:0@lo:400:kworker.0 00000100:00100000:0.0:1783135445.370480:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809107840:12345-0@lo:400:kworker.0 Request processed in 4198us (4467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135445.370494:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1783135445.370566:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135445.370571:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135445.370623:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809107840:0@lo:400:kworker.0 00010000:00010000:2.0:1783135445.878183:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783135446.386234:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000020:00000080:1.0:1783135446.386245:0:9520:0:(genops.c:906:class_export_put()) final put ffff8ac67c5e9800/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000001:00100000:3.0:1783135446.388583:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000020:00000080:3.0:1783135446.388594:0:8431:0:(genops.c:906:class_export_put()) final put ffff8ac67c629000/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000020:00000080:0.0:1783135446.388655:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c5e9800/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe for lustre-OST0001 00000020:00000080:0.0:1783135446.388719:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c5ef800 for lustre-OST0001 00000020:00000080:1.0:1783135446.401298:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c629000/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe for lustre-OST0000 00000020:00000080:1.0:1783135446.401382:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c62e800 for lustre-OST0000 00010000:00010000:2.0:1783135446.894491:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135447.918782:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135448.431560:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135448.431584:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809108864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135448.431670:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135448.431819:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809108864 00000100:00100000:2.0:1783135448.431828:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809108864 00000100:00100000:2.0:1783135448.431885:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783135448.431893:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809108864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783135448.431935:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135448.431986:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809108864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135448.431993:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783135448.432108:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809108864:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135448.945548:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135449.968084:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135450.169229:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135450.169288:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135450.169332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135450.169464:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785970560 00000100:00100000:2.0:1783135450.169476:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785970560 00000100:00100000:1.0:1783135450.169484:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785970816 00000100:00100000:1.0:1783135450.169490:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785970816 00000100:00100000:2.0:1783135450.169536:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 283 00000100:00100000:1.0:1783135450.169547:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785970688 00000100:00100000:2.0:1783135450.169550:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2399:x1869752785970560:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135450.169552:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785970688 00000100:00100000:1.0:1783135450.169593:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:1.0:1783135450.169603:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785970816:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135450.169656:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785970816:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 53us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135450.169657:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2399:x1869752785970560:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 98us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135450.169673:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:2.0:1783135450.169675:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 283 00000100:00100000:1.0:1783135450.169719:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 105 00000100:00100000:1.0:1783135450.169727:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785970688:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135450.169761:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785970688:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 34us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135450.169769:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 105 00000100:00080000:0.0:1783135450.170629:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135450.170637:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135450.478333:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135450.478361:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809109120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135450.478361:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809108992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135450.478496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135450.478553:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135450.478559:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809109248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135450.478639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135450.478683:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809109376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135450.478710:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135450.478732:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135450.478738:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809109504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135450.478766:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135450.478809:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135450.478826:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809109120 00000100:00100000:3.0:1783135450.478833:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809109120 00000100:00100000:3.0:1783135450.478943:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783135450.478946:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809108992 00000100:00100000:0.0:1783135450.478952:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809108992 00000100:00100000:3.0:1783135450.478956:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809109120:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135450.478987:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809109376 00000100:00100000:0.0:1783135450.478992:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809109376 00000004:00000024:3.0:1783135450.478993:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783135450.479007:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809109248 00000100:00100000:0.0:1783135450.479010:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809109248 00000100:00100000:0.0:1783135450.479027:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809109504 00000100:00100000:0.0:1783135450.479030:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809109504 00000100:00100000:0.0:1783135450.479050:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783135450.479052:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809109120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135450.479060:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783135450.479082:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809108992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783135450.479133:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135450.479171:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809108992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135450.479178:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783135450.479194:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783135450.479200:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809109376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135450.479216:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135450.479243:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809109376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135450.479248:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783135450.479260:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135450.479266:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809109248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135450.479276:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135450.479300:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809109248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135450.479315:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135450.479327:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783135450.479332:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809109504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135450.479341:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135450.479362:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809109504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135450.479367:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1783135450.479384:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135450.479388:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783135450.479415:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84fb80 x1869752809109504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135450.479433:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809109504:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1783135450.479444:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84dc00 x1869752809109376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135450.479455:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809109376:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1783135450.479464:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b3480 x1869752809108992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135450.479475:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809108992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135450.481517:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809110016:0@lo:400:kworker.0 00000100:00100000:0.0:1783135450.481581:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135450.488016:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809109632:0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.488137:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135450.488185:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809110144:0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.488213:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783135450.488259:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e3b80 x1869752809109248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135450.488281:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809109248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135450.488295:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809109120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135450.488319:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783135450.488325:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809109760:0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.488345:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135450.488361:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809110272:0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.488379:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135450.491212:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809110144 00000100:00100000:2.0:1783135450.491226:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809110144 00000100:00100000:2.0:1783135450.491298:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809109760 00000100:00100000:2.0:1783135450.491302:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809109760 00000100:00100000:2.0:1783135450.491315:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809110272 00000100:00100000:2.0:1783135450.491317:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809110272 00000100:00100000:2.0:1783135450.491338:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783135450.491350:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809110144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.491458:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809110144:12345-0@lo:400:kworker.0 Request processed in 111us (3242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135450.491482:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783135450.491500:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783135450.491505:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809109760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.491539:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809109760:12345-0@lo:400:kworker.0 Request processed in 34us (3192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135450.491545:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783135450.491556:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135450.491561:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809110272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.491591:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809110272:12345-0@lo:400:kworker.0 Request processed in 30us (3211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135450.491596:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135450.491645:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809109760:0@lo:400:kworker.0 00010000:00080000:2.0:1783135450.491662:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543abf480 x1869752809110272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135450.491673:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809110272:0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.491686:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809110144:0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.493195:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809109632 00000100:00100000:2.0:1783135450.493209:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809109632 00000100:00100000:2.0:1783135450.493264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1783135450.493273:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809109632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.493360:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809109632:12345-0@lo:400:kworker.0 Request processed in 88us (5222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135450.493367:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:2.0:1783135450.493429:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783135450.493434:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135450.493452:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809109888:0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.493492:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135450.493521:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809110400:0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.493543:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135450.493570:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809109888 00000100:00100000:2.0:1783135450.493573:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809109888 00000100:00100000:2.0:1783135450.493592:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809110400 00000100:00100000:2.0:1783135450.493595:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809110400 00000100:00100000:2.0:1783135450.493618:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783135450.493624:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809109888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.493659:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809109888:12345-0@lo:400:kworker.0 Request processed in 35us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135450.493665:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783135450.493677:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783135450.493683:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809110400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.493711:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809110400:12345-0@lo:400:kworker.0 Request processed in 28us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135450.493716:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1783135450.493729:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135450.493755:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809109888:0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.493766:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809110400:0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.493796:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809109632:0@lo:400:kworker.0 00000100:00100000:0.0:1783135450.495518:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809110528:0@lo:400:kworker.0 00000100:00100000:0.0:1783135450.495574:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135450.496253:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809110528 00000100:00100000:2.0:1783135450.496264:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809110528 00000100:00100000:2.0:1783135450.496339:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783135450.496348:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809110528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135450.496409:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809110528:12345-0@lo:400:kworker.0 Request processed in 63us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135450.496416:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1783135450.496438:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783135450.496699:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543abd500 x1869752809110528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135450.496720:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809110528:0@lo:400:kworker.0 00000100:00100000:1.0:1783135450.498232:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809110016 00000100:00100000:1.0:1783135450.498253:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809110016 00000100:00100000:1.0:1783135450.498333:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783135450.498344:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809110016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135450.498440:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809110016:12345-0@lo:400:kworker.0 Request processed in 99us (16859us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135450.498448:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783135450.498506:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809110016:0@lo:400:kworker.0 00010000:00010000:2.0:1783135450.994144:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135451.066327:0:11133:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.84 00010000:00010000:1.0:1783135452.015257:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135453.040214:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135453.550928:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135453.550953:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809110656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135453.551021:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135453.551290:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809110656 00000100:00100000:2.0:1783135453.551298:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809110656 00000100:00100000:2.0:1783135453.551357:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783135453.551368:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809110656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783135453.551407:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135453.551457:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809110656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135453.551465:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783135453.551600:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543273100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809110656:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135454.062267:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135454.063415:0:11230:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.84 00010000:00010000:2.0:1783135455.088704:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135455.296526:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135455.296596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135455.296647:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135455.296728:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785970944 00000100:00100000:2.0:1783135455.296739:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785970944 00000100:00100000:2.0:1783135455.296801:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 285 00000100:00100000:2.0:1783135455.296812:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2401:x1869752785970944:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135455.296894:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2401:x1869752785970944:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 83us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135455.296904:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 285 00000100:00100000:0.0:1783135455.297195:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785971200 00000100:00100000:0.0:1783135455.297201:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785971200 00000100:00100000:0.0:1783135455.297267:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785971072 00000100:00100000:0.0:1783135455.297270:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785971072 00000100:00100000:0.0:1783135455.297295:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:0.0:1783135455.297303:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752785971200:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135455.297360:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752785971200:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 57us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135455.297366:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:0.0:1783135455.297380:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 113 00000100:00100000:0.0:1783135455.297386:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785971072:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135455.297412:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785971072:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135455.297417:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 113 00000100:00080000:2.0:1783135455.297558:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135455.297564:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135455.599974:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809110784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135455.600105:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135455.600214:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809110784 00000100:00100000:2.0:1783135455.600227:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809110784 00000100:00100000:2.0:1783135455.600290:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135455.600300:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809110784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135455.600333:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135455.600379:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809110784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135455.600386:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1783135455.600407:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783135455.600438:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543270700 x1869752809110784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135455.600459:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809110784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135455.600905:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809111040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135455.600940:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135455.600962:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135455.600968:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809110912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135455.600993:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135455.601029:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809111040 00000100:00100000:1.0:1783135455.601034:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809111040 00000100:00100000:1.0:1783135455.601065:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809110912 00000100:00100000:1.0:1783135455.601068:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809110912 00000100:00100000:1.0:1783135455.601109:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135455.601130:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809111040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135455.601170:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135455.601207:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809111040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135455.601214:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135455.601229:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783135455.601235:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809110912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135455.601246:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135455.601269:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809110912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135455.601275:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1783135455.601290:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783135455.601309:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac542798700 x1869752809110912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135455.601323:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809110912:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1783135455.601333:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac542799500 x1869752809111040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135455.601342:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809111040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135455.604493:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809111296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135455.604641:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135455.604715:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135455.604723:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809111168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135455.604750:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135455.604791:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809111168 00000100:00100000:1.0:1783135455.604807:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809111168 00000100:00100000:1.0:1783135455.604882:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783135455.604891:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809111168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135455.604920:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135455.604971:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809111168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135455.604979:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1783135455.605005:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783135455.605044:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543abd500 x1869752809111168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135455.605065:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809111168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135455.605364:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135455.605376:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809111424:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.605423:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135455.605478:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809111552:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.605506:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135455.605532:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809111552 00000100:00100000:3.0:1783135455.605536:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809111552 00000100:00100000:3.0:1783135455.606192:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783135455.606205:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809111552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.606260:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809111552:12345-0@lo:400:kworker.0 Request processed in 59us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135455.606267:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783135455.606305:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809111552:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.606356:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809111680:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.606397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135455.606430:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809111680 00000100:00100000:3.0:1783135455.606434:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809111680 00000100:00100000:3.0:1783135455.606457:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783135455.606462:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809111680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.606509:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809111680:12345-0@lo:400:kworker.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135455.606515:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783135455.606543:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809111680:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.606751:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135455.606759:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809111808:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.606807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135455.606910:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809111296 00000100:00100000:3.0:1783135455.606915:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809111296 00000100:00100000:3.0:1783135455.606935:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809111808 00000100:00100000:3.0:1783135455.606938:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809111808 00000100:00100000:3.0:1783135455.606954:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783135455.606960:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809111296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135455.606988:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135455.607035:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809111296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135455.607042:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783135455.607056:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783135455.607062:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809111808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.607126:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809111808:12345-0@lo:400:kworker.0 Request processed in 64us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135455.607144:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783135455.607172:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809111808:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.607203:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809111296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135455.607239:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809111936:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.607265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135455.607288:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809111936 00000100:00100000:3.0:1783135455.607291:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809111936 00000100:00100000:3.0:1783135455.607319:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783135455.607324:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809111936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.607352:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809111936:12345-0@lo:400:kworker.0 Request processed in 28us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135455.607358:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783135455.607383:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809111936:0@lo:400:kworker.0 00000100:00080000:3.0:1783135455.607397:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135455.607424:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809112064:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.607447:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135455.607469:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809112064 00000100:00100000:3.0:1783135455.607472:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809112064 00000100:00100000:3.0:1783135455.607936:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1783135455.607946:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809112064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135455.608119:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809111424 00000100:00100000:2.0:1783135455.608125:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809111424 00000100:00100000:2.0:1783135455.608155:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1783135455.608160:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809111424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.608230:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809112064:12345-0@lo:400:kworker.0 Request processed in 285us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135455.608236:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1783135455.608262:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135455.608304:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809112192:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.608332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135455.608360:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809112192 00000100:00100000:3.0:1783135455.608364:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809112192 00000100:00100000:3.0:1783135455.608391:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783135455.608397:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809112192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.608428:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809112192:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135455.608434:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783135455.608461:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809112192:0@lo:400:kworker.0 00000100:00080000:3.0:1783135455.608478:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135455.608522:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135455.608528:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809112320:0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.608552:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135455.608585:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809112320 00000100:00100000:3.0:1783135455.608588:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809112320 00000100:00100000:3.0:1783135455.608614:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783135455.608620:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809112320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135455.608651:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809112320:12345-0@lo:400:kworker.0 Request processed in 31us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135455.608657:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:3.0:1783135455.608684:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac66b599880 x1869752809112320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135455.608695:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809112320:0@lo:400:kworker.0 00000100:00080000:3.0:1783135455.608709:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135455.614166:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809111424:12345-0@lo:400:kworker.0 Request processed in 5992us (8730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135455.614184:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00010000:00080000:1.0:1783135455.614937:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c650380 x1869752809112064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135455.614955:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809112064:0@lo:400:kworker.0 00000100:00100000:1.0:1783135455.614971:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809111424:0@lo:400:kworker.0 00010000:00010000:1.0:1783135456.113742:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135457.134445:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135457.440320:0:11328:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.84 00010000:00010000:1.0:1783135458.158580:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135458.673319:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135458.673349:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809112448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135458.673433:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135458.673600:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809112448 00000100:00100000:2.0:1783135458.673611:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809112448 00000100:00100000:2.0:1783135458.673665:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783135458.673674:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809112448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783135458.673716:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135458.674380:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809112448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 704us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135458.674389:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783135458.674719:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543270700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809112448:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783135459.182460:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783135459.321541:0:11376:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 3 23:24:18 EDT 2026 00010000:00010000:1.0:1783135460.207405:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135460.411831:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135460.411919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135460.411964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135460.411997:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785971584 00000100:00100000:0.0:1783135460.412007:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785971584 00000100:00100000:0.0:1783135460.412062:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785971456 00000100:00100000:0.0:1783135460.412065:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785971456 00000100:00100000:0.0:1783135460.412135:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 120 00000100:00100000:0.0:1783135460.412146:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785971584:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135460.412236:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785971584:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135460.412438:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 121 00000100:00100000:3.0:1783135460.412459:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785971456:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135460.412507:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785971456:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 51us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135460.418626:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785971328 00000100:00100000:2.0:1783135460.418643:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785971328 00000100:00080000:1.0:1783135460.418745:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135460.418752:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135460.418992:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 287 00000100:00100000:2.0:1783135460.419004:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2400:x1869752785971328:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135460.419079:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2400:x1869752785971328:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 77us (7257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135460.419081:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 120 00000100:00100000:2.0:1783135460.419123:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 287 00000100:00100000:3.0:1783135460.421752:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 121 00000100:00100000:1.0:1783135460.718247:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809112576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135460.718324:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.718383:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809113088:0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.718396:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809112704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135460.718420:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135460.718435:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.718445:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809113600:0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.718450:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809113216:0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.718468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.718473:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809112960:0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.718486:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809113728:0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.718495:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.718509:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809113472:0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.718526:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.718540:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809113984:0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.718548:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.718559:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135460.718564:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809114240:0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.718599:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.718602:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809112576 00000100:00100000:1.0:1783135460.718609:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809112576 00000100:00100000:3.0:1783135460.718622:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1783135460.718627:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809112832:0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.718652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.718654:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809112704 00000100:00100000:1.0:1783135460.718657:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809112704 00000100:00100000:3.0:1783135460.718670:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809113344:0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.718673:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135460.718681:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809112576:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135460.718689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135460.718712:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809113856:0@lo:400:kworker.0 00002000:00000024:1.0:1783135460.718713:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135460.718747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.718749:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809112576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135460.718756:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783135460.718757:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809114368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135460.718773:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783135460.718779:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809112704:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135460.718787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1783135460.718789:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135460.718812:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809113728 00000100:00100000:3.0:1783135460.718815:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809113728 00000100:00100000:1.0:1783135460.718815:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809112704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135460.718821:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783135460.718837:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809113088 00000100:00100000:3.0:1783135460.718839:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809114240 00000100:00100000:3.0:1783135460.718846:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809114240 00000100:00100000:1.0:1783135460.718846:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809113088 00000100:00100000:1.0:1783135460.718862:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809113344 00000100:00100000:1.0:1783135460.718865:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809113344 00000100:00100000:3.0:1783135460.718867:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135460.718872:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809113728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.718874:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809114368 00000100:00100000:1.0:1783135460.718876:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809114368 00000100:00100000:1.0:1783135460.718886:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783135460.718890:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1869752809113088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.718901:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809113728:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135460.718907:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135460.718916:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1869752809113088:12345-0@lo:400:kworker.0 Request processed in 25us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135460.718934:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783135460.718936:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135460.718941:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809114240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.718945:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783135460.718949:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809113344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.718976:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809114240:12345-0@lo:400:kworker.0 Request processed in 34us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135460.718976:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809113344:12345-0@lo:400:kworker.0 Request processed in 25us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135460.718983:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135460.718983:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783135460.718993:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783135460.718999:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809114368:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135460.719000:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809113216 00000100:00100000:3.0:1783135460.719002:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809113216 00000100:00100000:3.0:1783135460.719017:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809112960 00000100:00100000:3.0:1783135460.719020:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809112960 00000004:00000024:1.0:1783135460.719020:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135460.719028:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809113472 00000100:00100000:3.0:1783135460.719030:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809113472 00000100:00100000:3.0:1783135460.719040:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809113984 00000100:00100000:3.0:1783135460.719042:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809113984 00000100:00100000:1.0:1783135460.719045:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809114368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135460.719051:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783135460.719053:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809113856 00000100:00100000:3.0:1783135460.719054:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809113856 00000100:00100000:3.0:1783135460.719067:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783135460.719071:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783135460.719072:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809113216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.719076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809112960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.719124:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809113216:12345-0@lo:400:kworker.0 Request processed in 51us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135460.719126:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809112960:12345-0@lo:400:kworker.0 Request processed in 50us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135460.719130:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783135460.720013:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783135460.720035:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783135460.720053:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809113472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.720120:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809113472:12345-0@lo:400:kworker.0 Request processed in 70us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135460.720127:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1783135460.720139:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783135460.720146:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809113984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.720172:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809113984:12345-0@lo:400:kworker.0 Request processed in 27us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135460.720177:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783135460.720199:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783135460.720205:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809113856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.720229:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809113856:12345-0@lo:400:kworker.0 Request processed in 24us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135460.720234:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1783135460.720264:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135460.720268:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135460.720271:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135460.720274:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135460.720293:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809114496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135460.720325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.720367:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809112960:0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.720378:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809113472:0@lo:400:kworker.0 00010000:00080000:1.0:1783135460.720391:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543766d80 x1869752809113984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135460.720401:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809113984:0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.720441:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135460.720461:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809114112:0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.720483:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783135460.720510:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac541d98000 x1869752809112576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135460.720525:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809112576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135460.720542:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809113088:0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.720558:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809114496 00000100:00100000:1.0:1783135460.720563:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809114496 00000100:00100000:2.0:1783135460.721277:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809112832 00000100:00100000:2.0:1783135460.721285:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809112832 00000100:00100000:2.0:1783135460.721317:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783135460.721324:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809112832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135460.721370:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809112832:12345-0@lo:400:kworker.0 Request processed in 47us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135460.721376:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783135460.721402:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809114112 00000100:00100000:2.0:1783135460.721405:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809114112 00000100:00100000:2.0:1783135460.721420:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135460.721425:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3649:x1869752809114112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135460.722343:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3649:x1869752809114112:12345-0@lo:400:kworker.0 Request processed in 913us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135460.722354:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135460.724939:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135460.725118:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809114624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135460.725199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135460.725248:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809114624 00000100:00100000:2.0:1783135460.725256:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809114624 00000100:00100000:2.0:1783135460.725314:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783135460.725324:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809114624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135460.725356:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135460.725402:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543271180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809114624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135460.725409:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1783135460.725450:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543abc000 x1869752809114624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135460.725469:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809114624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135460.725556:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809113600 00000100:00100000:3.0:1783135460.725562:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809113600 00000100:00100000:3.0:1783135460.725618:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783135460.725638:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809113600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.725676:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809113600:12345-0@lo:400:kworker.0 Request processed in 40us (5234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135460.725681:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1783135460.726661:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135460.726670:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135460.726830:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543963480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809112832:0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.726850:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809113344:0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.726862:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809113856:0@lo:400:kworker.0 00000100:00100000:3.0:1783135460.726880:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809114368:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1783135460.726894:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac66b599880 x1869752809112704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135460.726908:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809112704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135460.726933:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809113216:0@lo:400:kworker.0 00010000:00080000:3.0:1783135460.726943:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543766300 x1869752809113728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135460.727084:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809113728:0@lo:400:kworker.0 00010000:00080000:3.0:1783135460.727118:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543765880 x1869752809114240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135460.727125:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809114240:0@lo:400:kworker.0 00010000:00080000:3.0:1783135460.727200:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543839180 x1869752809113600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135460.727232:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809113600:0@lo:400:kworker.0 00010000:00080000:3.0:1783135460.727246:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543765f80 x1869752809114112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135460.727254:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809114112:0@lo:400:kworker.0 00000100:00100000:1.0:1783135460.728307:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783135460.728323:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809114496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135460.728349:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135460.728427:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809114496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (8101us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135460.728435:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1783135460.728473:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543abe680 x1869752809114496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135460.728491:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809114496:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783135461.234985:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135462.262183:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135463.290592:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135463.791363:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135463.791391:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809114752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135463.791482:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135463.791813:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809114752 00000100:00100000:2.0:1783135463.791822:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809114752 00000100:00100000:2.0:1783135463.791887:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783135463.791906:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809114752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783135463.791951:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135463.792027:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809114752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135463.792035:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783135463.792255:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809114752:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135464.310719:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135465.326396:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135465.534851:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135465.534902:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135465.534931:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135465.535566:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785971712 00000100:00100000:3.0:1783135465.535577:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785971712 00000100:00100000:1.0:1783135465.536106:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785971840 00000100:00100000:1.0:1783135465.536112:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785971840 00000100:00100000:1.0:1783135465.536174:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785971968 00000100:00100000:1.0:1783135465.536178:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785971968 00000100:00100000:1.0:1783135465.536224:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 128 00000100:00100000:1.0:1783135465.536236:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785971840:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135465.536336:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785971840:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 103us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135465.536343:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 128 00000100:00100000:1.0:1783135465.536360:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 129 00000100:00100000:1.0:1783135465.536367:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785971968:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135465.536394:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785971968:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135465.536400:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 129 00000100:00100000:3.0:1783135465.539198:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 289 00000100:00100000:3.0:1783135465.539216:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2400:x1869752785971712:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135465.546923:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2400:x1869752785971712:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 7702us (12007us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135465.546939:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 289 00000100:00080000:3.0:1783135465.547017:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135465.547023:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135465.838502:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135465.838528:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809114880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135465.838604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135465.838681:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809114880 00000100:00100000:1.0:1783135465.838690:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809114880 00000100:00100000:1.0:1783135465.838749:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783135465.838760:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809114880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135465.838796:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135465.838873:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809114880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135465.838881:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1783135465.838906:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783135465.838943:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c60f800 x1869752809114880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135465.838964:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809114880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135465.839313:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135465.839325:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809115008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135465.839360:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135465.839408:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809115008 00000100:00100000:2.0:1783135465.839412:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809115008 00000100:00100000:2.0:1783135465.839444:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783135465.839451:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809115008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135465.839471:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135465.839504:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543272d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809115008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135465.839510:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1783135465.839525:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783135465.839543:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543270380 x1869752809115008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135465.839557:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809115008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135465.840911:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135465.840931:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809115136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135465.840981:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135465.841028:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809115136 00000100:00100000:1.0:1783135465.841034:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809115136 00000100:00100000:1.0:1783135465.841079:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783135465.841102:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809115136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135465.841123:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135465.841162:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809115136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135465.841169:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1783135465.841187:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783135465.841211:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c60f800 x1869752809115136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135465.841228:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809115136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135465.841599:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135465.841610:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809115264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135465.841643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135465.841672:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809115264 00000100:00100000:2.0:1783135465.841675:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809115264 00000100:00100000:2.0:1783135465.841705:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783135465.841724:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809115264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135465.841752:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783135465.841788:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809115264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135465.841795:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783135465.841842:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809115264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135465.842440:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809115648:0@lo:400:kworker.0 00000100:00100000:1.0:1783135465.842477:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135465.842499:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809116160:0@lo:400:kworker.0 00000100:00100000:1.0:1783135465.842518:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135465.842537:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1783135465.842542:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809115520:0@lo:400:kworker.0 00000100:00100000:1.0:1783135465.842567:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135465.842592:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809116032:0@lo:400:kworker.0 00000100:00100000:1.0:1783135465.842612:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135465.842626:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809116544:0@lo:400:kworker.0 00000100:00100000:1.0:1783135465.842658:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135465.842683:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809115648 00000100:00100000:1.0:1783135465.842687:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809115648 00000100:00100000:3.0:1783135465.842810:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809116160 00000100:00100000:3.0:1783135465.842814:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809116160 00000100:00100000:3.0:1783135465.842855:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809116032 00000100:00100000:3.0:1783135465.842869:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809116032 00000100:00100000:3.0:1783135465.842882:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809116544 00000100:00100000:3.0:1783135465.842884:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809116544 00000100:00100000:3.0:1783135465.842898:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783135465.842906:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809115648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.842954:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809115648:12345-0@lo:400:kworker.0 Request processed in 49us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135465.842959:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783135465.842985:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783135465.842991:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809116160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843019:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809116160:12345-0@lo:400:kworker.0 Request processed in 28us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135465.843025:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783135465.843037:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783135465.843043:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809116032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843067:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809116032:12345-0@lo:400:kworker.0 Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135465.843073:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783135465.843084:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783135465.843119:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809116544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843145:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809116544:12345-0@lo:400:kworker.0 Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135465.843150:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1783135465.843168:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135465.843172:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135465.843182:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809115776:0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843210:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135465.843233:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809116288:0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843257:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135465.843277:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783135465.843282:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809115392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135465.843303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135465.843323:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809115904:0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135465.843371:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809116416:0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843392:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135465.843412:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809115776 00000100:00100000:3.0:1783135465.843415:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809115776 00000100:00100000:3.0:1783135465.843430:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809116416 00000100:00100000:3.0:1783135465.843433:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809116416 00000100:00100000:3.0:1783135465.843451:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783135465.843457:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809115776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843490:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809115776:12345-0@lo:400:kworker.0 Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135465.843495:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783135465.843513:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783135465.843519:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809116416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843545:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809116416:12345-0@lo:400:kworker.0 Request processed in 27us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135465.843550:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783135465.843567:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809116288 00000100:00100000:3.0:1783135465.843570:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809116288 00000100:00100000:3.0:1783135465.843597:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135465.843604:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809116288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843634:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809116288:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135465.843640:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1783135465.843659:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135465.843662:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135465.843670:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809115904 00000100:00100000:3.0:1783135465.843680:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809115904 00000100:00100000:3.0:1783135465.843707:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135465.843727:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809115904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843759:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809115904:12345-0@lo:400:kworker.0 Request processed in 46us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135465.843766:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135465.843786:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809115392 00000100:00100000:3.0:1783135465.843789:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809115392 00000100:00100000:3.0:1783135465.843811:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783135465.843818:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809115392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135465.843844:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135465.843875:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809115392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135465.843880:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1783135465.843919:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c60f800 x1869752809115392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135465.843939:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809115392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135465.843952:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809115904:0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843961:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809116416:0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.843969:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809115776:0@lo:400:kworker.0 00010000:00080000:3.0:1783135465.843977:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543767480 x1869752809116288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135465.843985:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809116288:0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.844034:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809116032:0@lo:400:kworker.0 00010000:00080000:3.0:1783135465.844054:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543839180 x1869752809116544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135465.844062:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809116544:0@lo:400:kworker.0 00000100:00100000:3.0:1783135465.844073:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809115648:0@lo:400:kworker.0 00010000:00080000:3.0:1783135465.844083:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543767100 x1869752809116160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135465.844116:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809116160:0@lo:400:kworker.0 00000100:00100000:1.0:1783135465.844980:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809115520 00000100:00100000:1.0:1783135465.844988:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809115520 00000100:00100000:1.0:1783135465.845026:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1783135465.845034:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809115520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135465.845105:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809115520:12345-0@lo:400:kworker.0 Request processed in 72us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135465.845111:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1783135465.847135:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809115520:0@lo:400:kworker.0 00010000:00010000:1.0:1783135466.352544:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135467.374577:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135468.399347:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135468.915670:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135468.936888:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809116672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135468.936966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135468.937231:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809116672 00000100:00100000:0.0:1783135468.937239:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809116672 00000100:00100000:0.0:1783135468.937285:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783135468.937294:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809116672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135468.937345:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135468.937389:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809116672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135468.937395:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783135468.939526:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809116672:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135469.424470:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135470.446829:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135470.656718:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135470.656830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135470.656880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135470.656909:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785972352 00000100:00100000:2.0:1783135470.656918:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785972352 00000100:00100000:2.0:1783135470.656982:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785972224 00000100:00100000:2.0:1783135470.656985:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785972224 00000100:00100000:2.0:1783135470.657005:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 136 00000100:00100000:2.0:1783135470.657014:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785972352:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135470.657083:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785972352:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135470.657121:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 136 00000100:00100000:2.0:1783135470.657137:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 137 00000100:00100000:2.0:1783135470.657143:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785972224:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135470.657165:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785972224:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 22us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135470.657171:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 137 00000100:00080000:2.0:1783135470.657186:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135470.657190:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135470.669004:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785972096 00000100:00100000:0.0:1783135470.669020:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785972096 00000100:00100000:0.0:1783135470.669115:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 291 00000100:00100000:0.0:1783135470.669124:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2398:x1869752785972096:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135470.669208:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2398:x1869752785972096:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 85us (12500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135470.669215:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 291 00000100:00100000:2.0:1783135470.959685:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135470.959706:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809116800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135470.959790:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135470.959868:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809116800 00000100:00100000:2.0:1783135470.959875:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809116800 00000100:00100000:2.0:1783135470.959917:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783135470.959925:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac672e63450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809116800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135470.959958:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783135470.960004:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac672e63450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809116800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135470.960022:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783135470.960391:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809116800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135470.960646:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809116928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135470.960679:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135470.960717:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809116928 00000100:00100000:3.0:1783135470.960721:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809116928 00000100:00100000:3.0:1783135470.960780:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783135470.960788:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809116928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135470.960811:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135470.960847:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809116928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135470.960853:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1783135470.960883:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783135470.960913:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438aed80 x1869752809116928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135470.960927:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809116928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135470.962913:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809117312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135470.962970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135470.963382:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809117056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135470.963433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135470.963458:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135470.963464:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809117184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135470.963498:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135470.963539:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809117312 00000100:00100000:3.0:1783135470.963545:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809117312 00000100:00100000:3.0:1783135470.963583:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809117056 00000100:00100000:3.0:1783135470.963586:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809117056 00000100:00100000:3.0:1783135470.963598:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809117184 00000100:00100000:3.0:1783135470.963600:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809117184 00000100:00100000:3.0:1783135470.963615:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783135470.963623:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809117312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135470.963659:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135470.963702:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809117312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135470.963709:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783135470.963736:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135470.963743:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809117056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135470.963753:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135470.963792:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809117056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135470.963798:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135470.964222:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135470.964230:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809117184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135470.964244:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135470.964273:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809117184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135470.964289:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1783135470.964312:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135470.964315:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135470.964344:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543963100 x1869752809117312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135470.964363:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809117312:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1783135470.964395:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543962a00 x1869752809117184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135470.964408:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809117184:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783135470.964418:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543271c00 x1869752809117056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135470.964428:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809117056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135470.965256:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809117696:0@lo:400:kworker.0 00000100:00100000:2.0:1783135470.965303:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135470.965330:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809118208:0@lo:400:kworker.0 00000100:00100000:2.0:1783135470.965352:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135470.965384:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783135470.965390:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809117568:0@lo:400:kworker.0 00000100:00100000:2.0:1783135470.965422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135470.965440:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809118080:0@lo:400:kworker.0 00000100:00100000:2.0:1783135470.965461:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135470.965500:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809117696 00000100:00100000:2.0:1783135470.965505:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809117696 00000100:00100000:2.0:1783135470.965533:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809118208 00000100:00100000:2.0:1783135470.965536:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809118208 00000100:00100000:2.0:1783135470.965552:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809117568 00000100:00100000:2.0:1783135470.965554:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809117568 00000100:00100000:2.0:1783135470.965563:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809118080 00000100:00100000:2.0:1783135470.965565:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809118080 00000100:00100000:2.0:1783135470.965579:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783135470.965586:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809117696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135470.965629:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809117696:12345-0@lo:400:kworker.0 Request processed in 43us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135470.965636:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783135470.965650:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783135470.965656:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809118208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135470.965694:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809118208:12345-0@lo:400:kworker.0 Request processed in 38us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135470.965700:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783135470.965711:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783135470.965717:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809117568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135470.965755:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809117568:12345-0@lo:400:kworker.0 Request processed in 38us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135470.965983:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783135470.965992:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809118080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966026:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809118080:12345-0@lo:400:kworker.0 Request processed in 36us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135470.966033:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783135470.966053:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809117824:0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135470.966183:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809118336:0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135470.966224:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135470.966229:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809117440:0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966256:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135470.966280:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809117952:0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135470.966321:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809117440 00000100:00100000:1.0:1783135470.966324:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809117440 00000100:00100000:1.0:1783135470.966353:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1783135470.966359:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809117440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966392:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809117440:12345-0@lo:400:kworker.0 Request processed in 33us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135470.966399:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1783135470.966427:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809118336 00000100:00100000:1.0:1783135470.966430:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809118336 00000100:00100000:1.0:1783135470.966446:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809117952 00000100:00100000:1.0:1783135470.966448:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809117952 00000100:00100000:1.0:1783135470.966460:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783135470.966465:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809118336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966507:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809118336:12345-0@lo:400:kworker.0 Request processed in 41us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135470.966513:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783135470.966524:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783135470.966530:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809117952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966556:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809117952:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135470.966568:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783135470.966599:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809117440:0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966611:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809117952:0@lo:400:kworker.0 00010000:00080000:1.0:1783135470.966621:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54279b800 x1869752809118336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135470.966631:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809118336:0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966655:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809117824 00000100:00100000:1.0:1783135470.966659:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809117824 00000100:00100000:1.0:1783135470.966684:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783135470.966691:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809117824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135470.966724:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809117824:12345-0@lo:400:kworker.0 Request processed in 34us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135470.966741:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783135470.966779:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809117824:0@lo:400:kworker.0 00000100:00100000:2.0:1783135470.971451:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783135470.971578:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809117568:0@lo:400:kworker.0 00010000:00080000:2.0:1783135470.971598:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543270380 x1869752809118080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135470.971610:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809118080:0@lo:400:kworker.0 00000100:00100000:2.0:1783135470.971623:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809117696:0@lo:400:kworker.0 00000100:00100000:2.0:1783135470.971635:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809118208:0@lo:400:kworker.0 00000100:00080000:3.0:1783135470.973078:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135470.973112:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783135471.484212:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135472.495415:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135473.523532:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135474.034975:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135474.035000:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809118464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135474.035074:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135474.036919:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809118464 00000100:00100000:2.0:1783135474.036934:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809118464 00000100:00100000:2.0:1783135474.037008:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783135474.037019:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809118464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783135474.037059:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135474.037174:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809118464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135474.037181:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783135474.039186:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809118464:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135474.548703:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135475.566568:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135475.769515:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135475.769572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135475.769614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135475.769650:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785972736 00000100:00100000:2.0:1783135475.769662:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785972736 00000100:00100000:2.0:1783135475.769727:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785972608 00000100:00100000:2.0:1783135475.769731:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785972608 00000100:00100000:2.0:1783135475.769756:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 144 00000100:00100000:2.0:1783135475.769767:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785972736:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135475.769848:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785972736:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135475.769855:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 144 00000100:00100000:2.0:1783135475.769876:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 145 00000100:00100000:2.0:1783135475.769881:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785972608:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135475.769906:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785972608:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135475.769912:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 145 00000100:00100000:3.0:1783135475.770543:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785972480 00000100:00100000:3.0:1783135475.770549:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785972480 00000100:00100000:3.0:1783135475.770599:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 293 00000100:00100000:3.0:1783135475.770607:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2399:x1869752785972480:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135475.770668:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2399:x1869752785972480:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 62us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135475.771374:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 293 00000100:00080000:3.0:1783135475.771418:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135475.771424:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135476.083608:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809118592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135476.083705:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135476.083774:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135476.083782:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809118720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135476.083807:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135476.083860:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809118848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135476.083885:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135476.083904:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135476.083909:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809118976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135476.083930:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135476.083961:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809118592 00000100:00100000:2.0:1783135476.083981:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809118592 00000100:00100000:2.0:1783135476.084028:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809118720 00000100:00100000:2.0:1783135476.084031:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809118720 00000100:00100000:2.0:1783135476.084044:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809118848 00000100:00100000:2.0:1783135476.084046:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809118848 00000100:00100000:2.0:1783135476.084064:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783135476.084073:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809118592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135476.084139:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135476.084185:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809118592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135476.084192:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783135476.084213:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783135476.084219:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809118720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135476.084234:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135476.084259:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809118720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135476.084264:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783135476.084275:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783135476.084280:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809118848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135476.084289:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135476.084315:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809118848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135476.084321:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783135476.084339:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809118976 00000100:00100000:2.0:1783135476.084342:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809118976 00000100:00100000:2.0:1783135476.084369:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783135476.084375:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809118976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135476.084407:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783135476.084437:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809118976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135476.084443:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1783135476.084461:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135476.084465:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135476.084496:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809118976:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1783135476.084510:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54279b800 x1869752809118848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135476.084523:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809118848:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1783135476.084557:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543963100 x1869752809118720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135476.084568:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809118720:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1783135476.084577:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438aea00 x1869752809118592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135476.084588:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809118592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135476.084882:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135476.084894:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809119104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135476.084925:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135476.084957:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809119104 00000100:00100000:0.0:1783135476.084960:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809119104 00000100:00100000:0.0:1783135476.084986:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783135476.084992:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809119104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135476.085003:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135476.085032:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809119104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135476.085038:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1783135476.085051:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783135476.085065:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543abf800 x1869752809119104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135476.085129:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809119104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135476.087391:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809119488:0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.087483:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135476.087515:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809120000:0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.087536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135476.087570:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783135476.087576:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809119360:0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.087597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135476.087613:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809119872:0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.087643:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135476.087682:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809119488 00000100:00100000:3.0:1783135476.087689:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809119488 00000100:00100000:3.0:1783135476.087724:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809120000 00000100:00100000:3.0:1783135476.087728:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809120000 00000100:00100000:3.0:1783135476.087748:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809119360 00000100:00100000:3.0:1783135476.087750:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809119360 00000100:00100000:3.0:1783135476.087759:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809119872 00000100:00100000:3.0:1783135476.087761:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809119872 00000100:00100000:3.0:1783135476.087776:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783135476.087784:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809119488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.087838:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809119488:12345-0@lo:400:kworker.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135476.087845:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783135476.087861:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783135476.087867:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809120000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.087893:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809120000:12345-0@lo:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135476.087899:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783135476.087909:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783135476.087922:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809119360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.087950:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809119360:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135476.087956:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783135476.087966:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783135476.087972:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809119872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.087996:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809119872:12345-0@lo:400:kworker.0 Request processed in 23us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135476.088001:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783135476.088054:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809119360:0@lo:400:kworker.0 00010000:00080000:3.0:1783135476.088065:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438ac000 x1869752809119872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135476.088075:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809119872:0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.088084:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809119488:0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.088135:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809120000:0@lo:400:kworker.0 00000100:00100000:2.0:1783135476.088470:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809119616:0@lo:400:kworker.0 00000100:00100000:2.0:1783135476.088509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135476.088540:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809120128:0@lo:400:kworker.0 00000100:00100000:2.0:1783135476.088562:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135476.088638:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783135476.088646:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809119232:0@lo:400:kworker.0 00000100:00100000:2.0:1783135476.089798:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135476.089864:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809119744:0@lo:400:kworker.0 00000100:00100000:2.0:1783135476.089897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135476.089966:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809119616 00000100:00100000:3.0:1783135476.089975:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809119616 00000100:00100000:3.0:1783135476.090028:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783135476.090038:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809119616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135476.090109:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809119616:12345-0@lo:400:kworker.0 Request processed in 72us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135476.090116:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1783135476.091143:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135476.091154:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135476.091198:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809119232 00000100:00100000:0.0:1783135476.091206:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809119232 00000100:00100000:0.0:1783135476.091262:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1783135476.091272:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809119232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135476.091335:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809119232:12345-0@lo:400:kworker.0 Request processed in 65us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135476.091341:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1783135476.115953:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809119616:0@lo:400:kworker.0 00000100:00100000:2.0:1783135476.115988:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809119232:0@lo:400:kworker.0 00000100:00100000:1.0:1783135476.116080:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809120128 00000100:00100000:1.0:1783135476.116108:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809120128 00000100:00080000:1.0:1783135476.116170:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135476.116195:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809119744 00000100:00100000:0.0:1783135476.116200:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809119744 00000100:00100000:2.0:1783135476.116219:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783135476.116229:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809120128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135476.116243:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783135476.116249:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809119744:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783135476.116314:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135476.122239:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809119744:12345-0@lo:400:kworker.0 Request processed in 5979us (32329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135476.122255:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783135476.122618:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809119744:0@lo:400:kworker.0 00000100:00100000:2.0:1783135476.126644:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809120128:12345-0@lo:400:kworker.0 Request processed in 10386us (38050us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135476.126660:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:3.0:1783135476.127833:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438af800 x1869752809120128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135476.127852:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809120128:0@lo:400:kworker.0 00010000:00010000:0.0:1783135476.590673:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135477.614545:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135478.642824:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135479.151883:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809120256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135479.151966:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135479.152197:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809120256 00000100:00100000:1.0:1783135479.152219:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809120256 00000100:00100000:1.0:1783135479.152272:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783135479.152281:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809120256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135479.152316:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135479.152361:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809120256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135479.152371:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783135479.152422:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543960380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809120256:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1783135479.444803:0:12008:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:24:38 (1783135478) === 00010000:00010000:1.0:1783135479.666081:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135480.203612:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135480.209818:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785972864 00000100:00100000:1.0:1783135480.209835:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785972864 00000100:00100000:1.0:1783135480.209981:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 295 00000100:00100000:1.0:1783135480.209992:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:8743:x1869752785972864:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135480.210021:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135480.210040:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edfa95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140b2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135480.210070:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edfa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b2b expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135480.210082:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edfa95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b2b expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135480.211376:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a600, rc 0) 00000100:00100000:1.0:1783135480.211453:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8743:x1869752785972864:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 1460us (7848us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135480.211462:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 295 00000100:00100000:2.0:1783135480.232001:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135480.232133:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785972992 00000100:00100000:3.0:1783135480.232146:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785972992 00000100:00100000:3.0:1783135480.232233:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 296 00000100:00100000:3.0:1783135480.232245:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8743:x1869752785972992:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783135480.232466:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8743:x1869752785972992:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 222us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135480.232475:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 296 00000100:00100000:2.0:1783135480.253962:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135480.258719:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785973120 00000100:00100000:1.0:1783135480.258740:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785973120 00000100:00100000:1.0:1783135480.258838:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 297 00000100:00100000:1.0:1783135480.258851:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8743:x1869752785973120:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783135480.259073:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8743:x1869752785973120:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 224us (5125us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135480.259083:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 297 00000100:00100000:2.0:1783135480.278924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135480.279274:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785973248 00000100:00100000:0.0:1783135480.279288:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785973248 00000100:00100000:0.0:1783135480.279372:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 298 00000100:00100000:0.0:1783135480.279386:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8747:x1869752785973248:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135480.279643:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8747:x1869752785973248:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 259us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135480.279660:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 298 00000100:00100000:2.0:1783135480.326934:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135480.327125:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785973376 00000100:00100000:3.0:1783135480.327138:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785973376 00000100:00100000:3.0:1783135480.327223:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 299 00000100:00100000:3.0:1783135480.327234:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8747:x1869752785973376:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135480.327451:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8747:x1869752785973376:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 218us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135480.327461:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 299 00000100:00100000:2.0:1783135480.338008:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135480.346081:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785973504 00000100:00100000:1.0:1783135480.346113:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785973504 00000100:00100000:2.0:1783135480.346343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 300 00000100:00100000:2.0:1783135480.346355:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8747:x1869752785973504:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135480.347137:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8747:x1869752785973504:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 779us (9140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135480.347148:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 300 00000100:00100000:2.0:1783135480.365575:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135480.377623:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785973632 00000100:00100000:0.0:1783135480.377643:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785973632 00000100:00100000:0.0:1783135480.377743:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 301 00000100:00100000:0.0:1783135480.377755:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:8743:x1869752785973632:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135480.377777:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135480.377809:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edfa9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140b5c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.377846:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edfa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b5c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.377859:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edfa9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b5c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.377869:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65de00, rc 0) 00000100:00100000:0.0:1783135480.377962:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:8743:x1869752785973632:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 209us (12410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135480.377970:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 301 00000100:00100000:3.0:1783135480.383305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135480.387841:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785973760 00000100:00100000:2.0:1783135480.387862:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785973760 00000100:00100000:2.0:1783135480.387950:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 302 00000100:00100000:2.0:1783135480.387960:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:8743:x1869752785973760:12345-192.168.204.6@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783135480.388015:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783135480.388037:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783135480.388041:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783135480.388046:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783135480.388049:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1783135480.388052:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1783135480.393747:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:8743:x1869752785973760:12345-192.168.204.6@tcp:256:mount.lustre.0 Request processed in 5769us (10450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135480.393769:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 302 00000100:00100000:3.0:1783135480.399259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135480.400783:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785973888 00000100:00100000:2.0:1783135480.400801:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785973888 00000100:00100000:2.0:1783135480.400888:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 303 00000100:00100000:2.0:1783135480.400899:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:8743:x1869752785973888:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135480.400921:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135480.400943:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfaa3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140b63 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135480.400978:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfaa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b63 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135480.400990:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfaa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b63 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135480.401001:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f000, rc 0) 00000100:00100000:2.0:1783135480.401118:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:8743:x1869752785973888:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 189us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135480.401126:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 303 00000100:00100000:2.0:1783135480.414874:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135480.417995:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785974016 00000100:00100000:3.0:1783135480.418017:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785974016 00000100:00100000:3.0:1783135480.418180:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 304 00000100:00100000:3.0:1783135480.418193:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:8743:x1869752785974016:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783135480.418418:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:8743:x1869752785974016:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 227us (3558us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135480.418427:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 304 00000100:00100000:3.0:1783135480.422221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135480.425775:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785974144 00000100:00100000:0.0:1783135480.425797:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785974144 00000100:00100000:0.0:1783135480.425899:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 305 00000100:00100000:0.0:1783135480.425912:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:8743:x1869752785974144:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783135480.426181:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:8743:x1869752785974144:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 270us (3972us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135480.426191:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 305 00000100:00100000:0.0:1783135480.430604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135480.437017:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785974272 00000100:00100000:2.0:1783135480.437045:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785974272 00000100:00100000:2.0:1783135480.437169:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 306 00000100:00100000:2.0:1783135480.437203:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:8753:x1869752785974272:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135480.437468:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:8753:x1869752785974272:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 267us (6884us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135480.437477:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 306 00000100:00100000:2.0:1783135480.441248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135480.441415:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785974400 00000100:00100000:3.0:1783135480.441429:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785974400 00000100:00100000:3.0:1783135480.441506:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 307 00000100:00100000:3.0:1783135480.441519:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:8753:x1869752785974400:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135480.441752:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:8753:x1869752785974400:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 235us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135480.441762:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 307 00000100:00100000:3.0:1783135480.451147:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135480.451200:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135480.451243:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135480.451264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135480.460968:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785975168 00000100:00100000:0.0:1783135480.460992:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785975168 00000100:00100000:0.0:1783135480.461105:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785975296 00000100:00100000:0.0:1783135480.461109:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785975296 00000100:00100000:0.0:1783135480.461129:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785974528 00000100:00100000:0.0:1783135480.461132:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785974528 00000100:00100000:0.0:1783135480.461143:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785974784 00000100:00100000:0.0:1783135480.461145:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785974784 00000100:00100000:0.0:1783135480.461179:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 152 00000100:00100000:0.0:1783135480.461191:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785975168:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135480.461326:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785975168:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 138us (10240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135480.461335:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 152 00000100:00100000:0.0:1783135480.461358:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 153 00000100:00100000:0.0:1783135480.461365:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785975296:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135480.461390:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785975296:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (10190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135480.461397:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 153 00000100:00100000:0.0:1783135480.461408:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:0.0:1783135480.461413:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1869752785974528:12345-192.168.204.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783135480.461443:0:8461:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40@192.168.204.6@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:0.0:1783135480.461499:0:8461:0:(genops.c:1406:class_connect()) connect: client eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40, cookie 0xf7de4ef628edfaaa 00000004:00100000:0.0:1783135480.461536:0:8461:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783135480.461697:0:8461:0:(import.c:65:import_set_state_nolock()) ffff8ac67c62e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135480.461732:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2397:x1869752785974528:12345-192.168.204.6@tcp:38:mount.lustre.0 Request processed in 317us (10488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135480.461758:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:0.0:1783135480.461803:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:0.0:1783135480.461808:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1869752785974784:12345-192.168.204.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783135480.461825:0:8461:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40@192.168.204.6@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:0.0:1783135480.461852:0:8461:0:(genops.c:1406:class_connect()) connect: client eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40, cookie 0xf7de4ef628edfab1 00000004:00100000:0.0:1783135480.461866:0:8461:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783135480.461931:0:8461:0:(import.c:65:import_set_state_nolock()) ffff8ac67c629800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135480.461957:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2397:x1869752785974784:12345-192.168.204.6@tcp:38:mount.lustre.0 Request processed in 146us (10691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135480.461964:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00080000:3.0:1783135480.462135:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135480.462140:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135480.466248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135480.466288:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135480.466318:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135480.466392:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785975040 00000100:00100000:1.0:1783135480.466406:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785975040 00000100:00100000:1.0:1783135480.466475:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785974912 00000100:00100000:1.0:1783135480.466478:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785974912 00000100:00100000:1.0:1783135480.466493:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785974656 00000100:00100000:1.0:1783135480.466495:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785974656 00000100:00100000:1.0:1783135480.466507:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:1.0:1783135480.466517:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+7:8743:x1869752785975040:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135480.466579:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783135480.466693:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+7:8743:x1869752785975040:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 177us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135480.466701:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:1.0:1783135480.466718:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:1.0:1783135480.466724:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:0:x1869752785974912:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135480.466741:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135480.466770:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:0:x1869752785974912:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 47us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135480.466776:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:1.0:1783135480.466807:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:1.0:1783135480.466813:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:0:x1869752785974656:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135480.466822:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783135480.466841:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:0:x1869752785974656:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 29us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135480.466847:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00080000:0.0:1783135480.467405:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135480.467410:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135480.481373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135480.486589:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785975424 00000100:00100000:1.0:1783135480.486612:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785975424 00000100:00100000:1.0:1783135480.486724:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:1.0:1783135480.486736:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:8743:x1869752785975424:12345-192.168.204.6@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783135480.486874:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:8743:x1869752785975424:12345-192.168.204.6@tcp:40:mount.lustre.0 Request processed in 140us (5516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135480.486883:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:1.0:1783135480.497407:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135480.497469:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135480.497512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135480.497941:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785975808 00000100:00100000:2.0:1783135480.497956:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785975808 00000100:00100000:2.0:1783135480.498032:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:2.0:1783135480.498046:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:8743:x1869752785975808:12345-192.168.204.6@tcp:900:mount.lustre.0 00000100:00100000:2.0:1783135480.498193:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:8743:x1869752785975808:12345-192.168.204.6@tcp:900:mount.lustre.0 Request processed in 149us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135480.498202:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:3.0:1783135480.498336:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785975552 00000100:00100000:3.0:1783135480.498342:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785975552 00000100:00100000:3.0:1783135480.498372:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785975680 00000100:00100000:3.0:1783135480.498375:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785975680 00000100:00100000:3.0:1783135480.498397:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:3.0:1783135480.498403:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1869752785975552:12345-192.168.204.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783135480.498434:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40@192.168.204.6@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:3.0:1783135480.498493:0:8435:0:(genops.c:1406:class_connect()) connect: client eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40, cookie 0xf7de4ef628edfab8 00002000:00100000:3.0:1783135480.498511:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40/ffff8ac543909800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783135480.498536:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1783135480.498837:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:1.0:1783135480.498843:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1869752785975680:12345-192.168.204.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783135480.498863:0:8437:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40@192.168.204.6@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:1.0:1783135480.498884:0:8437:0:(genops.c:1406:class_connect()) connect: client eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40, cookie 0xf7de4ef628edfabf 00002000:00100000:1.0:1783135480.498890:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40/ffff8ac54392e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783135480.498909:0:8437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783135480.498981:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783135480.499018:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8ac543929800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135480.499070:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2397:x1869752785975680:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 226us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135480.499077:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00002000:00080000:3.0:1783135480.501272:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783135480.501327:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8ac54390f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135480.501422:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2397:x1869752785975552:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 3015us (3949us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135480.501443:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:0.0:1783135480.501651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135480.503895:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785975936 00000100:00100000:3.0:1783135480.503916:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785975936 00000100:00100000:3.0:1783135480.504008:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:3.0:1783135480.504020:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:8743:x1869752785975936:12345-192.168.204.6@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783135480.504190:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783135480.504313:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:8743:x1869752785975936:12345-192.168.204.6@tcp:33:mount.lustre.0 Request processed in 295us (2662us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135480.504322:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00010000:00010000:0.0:1783135480.686402:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135481.198644:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809120384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135481.198743:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135481.198831:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135481.198838:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809120512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135481.198863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135481.198913:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809120384 00000100:00100000:3.0:1783135481.198922:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809120384 00000100:00100000:3.0:1783135481.198986:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809120512 00000100:00100000:3.0:1783135481.198989:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809120512 00000100:00100000:3.0:1783135481.199011:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783135481.199041:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809120384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135481.199072:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135481.199151:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809120384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135481.199159:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783135481.199179:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783135481.199186:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809120512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135481.199199:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135481.199226:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809120512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135481.199232:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1783135481.199254:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135481.199258:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135481.199289:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543270380 x1869752809120512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135481.199312:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543270380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809120512:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783135481.199325:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54279b800 x1869752809120384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135481.199338:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809120384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135481.199441:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809120640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135481.199477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135481.199880:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809120768:0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.199919:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135481.199957:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809121280:0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.199984:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135481.200001:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809121792:0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.200023:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135481.200044:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783135481.200050:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809121152:0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.200072:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135481.200124:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809121664:0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.200149:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135481.200181:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809121280 00000100:00100000:1.0:1783135481.200186:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809121280 00000100:00100000:1.0:1783135481.200228:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783135481.200237:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809121280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.200284:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809121280:12345-0@lo:400:kworker.0 Request processed in 47us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135481.200290:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783135481.200315:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809121792 00000100:00100000:1.0:1783135481.200319:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809121792 00000100:00100000:1.0:1783135481.200348:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809121152 00000100:00100000:1.0:1783135481.200363:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809121152 00000100:00100000:1.0:1783135481.200378:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809121664 00000100:00100000:1.0:1783135481.200380:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809121664 00000100:00100000:1.0:1783135481.200394:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783135481.200400:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809121792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.200435:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809121792:12345-0@lo:400:kworker.0 Request processed in 34us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135481.200442:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783135481.200454:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783135481.200459:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809121152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.200491:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809121152:12345-0@lo:400:kworker.0 Request processed in 32us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135481.200498:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783135481.200509:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783135481.200515:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809121664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.200557:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809121664:12345-0@lo:400:kworker.0 Request processed in 41us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135481.200564:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783135481.200694:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809121152:0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.200705:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809121664:0@lo:400:kworker.0 00000100:00100000:1.0:1783135481.200714:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809121280:0@lo:400:kworker.0 00010000:00080000:1.0:1783135481.200724:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b193800 x1869752809121792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135481.200734:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809121792:0@lo:400:kworker.0 00000100:00100000:2.0:1783135481.201018:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809120768 00000100:00100000:2.0:1783135481.201025:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809120768 00000100:00100000:2.0:1783135481.201069:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783135481.201077:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809120768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135481.201146:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809120768:12345-0@lo:400:kworker.0 Request processed in 70us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135481.201152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783135481.201209:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809120768:0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.201519:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809121024:0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.202145:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135481.202372:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809120640 00000100:00100000:0.0:1783135481.202379:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809120640 00000100:00100000:0.0:1783135481.202560:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783135481.202584:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809120640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135481.202610:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135481.202689:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809120640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (3211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135481.202697:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783135481.202863:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809121536:0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.202898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135481.202924:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809122048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135481.202958:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135481.202977:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1783135481.202984:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809120896:0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.203007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135481.203025:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809121408:0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.203046:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135481.203063:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809121920:0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.203110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135481.203141:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809121024 00000100:00100000:3.0:1783135481.203146:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809121024 00000100:00100000:3.0:1783135481.203184:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809122048 00000100:00100000:3.0:1783135481.203187:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809122048 00000100:00100000:3.0:1783135481.203201:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783135481.203208:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1869752809121024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.203252:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1869752809121024:12345-0@lo:400:kworker.0 Request processed in 44us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135481.203258:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783135481.203272:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783135481.203278:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809122048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135481.203297:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135481.203329:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809122048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135481.203335:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1783135481.203353:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135481.203359:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135481.203363:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135481.203379:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809121536 00000100:00100000:3.0:1783135481.203390:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809121536 00000100:00100000:3.0:1783135481.203417:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809120896 00000100:00100000:3.0:1783135481.203420:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809120896 00000100:00100000:3.0:1783135481.203444:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809121408 00000100:00100000:3.0:1783135481.203447:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809121408 00000100:00100000:3.0:1783135481.203463:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783135481.203469:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809121536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.203504:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809121536:12345-0@lo:400:kworker.0 Request processed in 35us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135481.203511:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783135481.203525:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783135481.203531:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809120896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.203575:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809120896:12345-0@lo:400:kworker.0 Request processed in 44us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135481.203582:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783135481.203595:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783135481.203601:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809121408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.203628:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809121408:12345-0@lo:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135481.203635:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1783135481.203649:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135481.203651:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135481.203688:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809120896:0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.203701:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809121408:0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.203715:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809122048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135481.203725:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809121024:0@lo:400:kworker.0 00010000:00080000:3.0:1783135481.203749:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b190e00 x1869752809121536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135481.203761:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809121536:0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.203821:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135481.203832:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809122176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135481.203861:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135481.229022:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809121920 00000100:00100000:3.0:1783135481.229043:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809121920 00000100:00100000:3.0:1783135481.229181:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783135481.229193:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809121920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135481.229305:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809121920:12345-0@lo:400:kworker.0 Request processed in 114us (26216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135481.229314:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1783135481.229340:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783135481.229384:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438ad880 x1869752809120640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135481.229410:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809120640:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1783135481.229465:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b192680 x1869752809121920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135481.229475:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809121920:0@lo:400:kworker.0 00000100:00100000:2.0:1783135481.231903:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809122176 00000100:00100000:2.0:1783135481.231922:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809122176 00000100:00100000:2.0:1783135481.232029:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783135481.232041:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809122176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135481.232120:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135481.232999:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809122176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 957us (29134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135481.233009:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1783135481.243971:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e2a00 x1869752809122176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135481.244009:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809122176:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1783135481.712136:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135482.735633:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135483.758395:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135484.271301:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809122304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135484.271390:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135484.271626:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809122304 00000100:00100000:1.0:1783135484.271635:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809122304 00000100:00100000:1.0:1783135484.271701:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783135484.271712:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809122304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135484.271748:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135484.271794:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809122304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135484.271802:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783135484.272896:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809122304:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135484.785355:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135485.496974:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135485.497016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135485.497038:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135485.497061:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135485.497079:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135485.497126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135485.497152:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135485.497179:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785976832 00000100:00100000:0.0:1783135485.497188:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785976832 00000100:00100000:0.0:1783135485.497240:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785976704 00000100:00100000:0.0:1783135485.497243:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785976704 00000100:00100000:0.0:1783135485.497269:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:0.0:1783135485.497280:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752785976832:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135485.497356:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752785976832:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135485.497364:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:0.0:1783135485.497381:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:0.0:1783135485.497388:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752785976704:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135485.497418:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752785976704:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 32us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135485.497423:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:3.0:1783135485.497596:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785976064 00000100:00100000:3.0:1783135485.497646:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785976064 00000100:00100000:3.0:1783135485.497683:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 309 00000100:00100000:3.0:1783135485.497691:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752785976064:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135485.497729:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752785976064:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 39us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135485.497737:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 309 00000100:00100000:3.0:1783135485.497770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785976320 00000100:00100000:3.0:1783135485.497773:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785976320 00000100:00100000:3.0:1783135485.497797:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785976576 00000100:00100000:3.0:1783135485.497799:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785976576 00000100:00100000:3.0:1783135485.497812:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785976192 00000100:00100000:3.0:1783135485.497814:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785976192 00000100:00100000:3.0:1783135485.497825:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785976448 00000100:00100000:3.0:1783135485.497828:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785976448 00000100:00100000:3.0:1783135485.497841:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 160 00000100:00100000:3.0:1783135485.497847:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785976320:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135485.497875:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785976320:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135485.497881:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 160 00000100:00100000:3.0:1783135485.497891:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 161 00000100:00100000:3.0:1783135485.497896:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752785976576:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135485.497916:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752785976576:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 20us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135485.497922:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 161 00000100:00100000:3.0:1783135485.497931:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 162 00000100:00100000:3.0:1783135485.497937:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785976192:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135485.497971:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785976192:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 34us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135485.497977:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 162 00000100:00100000:3.0:1783135485.497989:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 163 00000100:00100000:3.0:1783135485.497995:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752785976448:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135485.498015:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752785976448:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 21us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135485.498021:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 163 00000100:00080000:3.0:1783135485.498050:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135485.498054:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135485.498057:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135485.498059:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783135485.807506:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135486.319459:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809122560:0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.319539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.319598:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809123072:0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.319623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.319649:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809123584:0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.319672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.319701:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1783135486.319708:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809122432:0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320050:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809122816:0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320113:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135486.320136:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809123328:0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320159:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135486.320175:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809123840:0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320211:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135486.320239:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783135486.320246:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809122688:0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320272:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135486.320290:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809123200:0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320308:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135486.320318:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809123712:0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320351:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135486.320377:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809122560 00000100:00100000:0.0:1783135486.320385:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809122560 00000100:00100000:0.0:1783135486.320424:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809123072 00000100:00100000:0.0:1783135486.320426:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809123072 00000100:00100000:0.0:1783135486.320461:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809123584 00000100:00100000:0.0:1783135486.320465:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809123584 00000100:00100000:0.0:1783135486.320492:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809122816 00000100:00100000:0.0:1783135486.320495:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809122816 00000100:00100000:0.0:1783135486.320507:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809123200 00000100:00100000:0.0:1783135486.320509:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809123200 00000100:00100000:0.0:1783135486.320520:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809123712 00000100:00100000:0.0:1783135486.320522:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809123712 00000100:00100000:0.0:1783135486.320538:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783135486.320546:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809122560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320595:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809122560:12345-0@lo:400:kworker.0 Request processed in 50us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.320611:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1783135486.320628:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783135486.320634:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809123072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320665:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809123072:12345-0@lo:400:kworker.0 Request processed in 31us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.320671:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783135486.320682:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783135486.320688:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809123584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320714:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809123584:12345-0@lo:400:kworker.0 Request processed in 26us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.320720:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783135486.320729:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783135486.320749:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809122816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320780:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809122816:12345-0@lo:400:kworker.0 Request processed in 33us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.320786:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783135486.320797:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783135486.320803:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809123200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320829:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809123200:12345-0@lo:400:kworker.0 Request processed in 27us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.320835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783135486.320845:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783135486.320850:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809123712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.320875:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809123712:12345-0@lo:400:kworker.0 Request processed in 25us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.320886:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783135486.320904:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809123328 00000100:00100000:0.0:1783135486.320908:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809123328 00000100:00100000:0.0:1783135486.321197:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809123840 00000100:00100000:0.0:1783135486.321202:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809123840 00000100:00100000:0.0:1783135486.321225:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783135486.321232:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809123328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.321265:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809123328:12345-0@lo:400:kworker.0 Request processed in 33us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.321270:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783135486.321281:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783135486.321286:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809123840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.321310:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809123840:12345-0@lo:400:kworker.0 Request processed in 24us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.321316:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783135486.321349:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809122688 00000100:00100000:0.0:1783135486.321354:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809122688 00000100:00100000:0.0:1783135486.321378:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783135486.321385:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809122688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.321418:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809122688:12345-0@lo:400:kworker.0 Request processed in 34us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.321424:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1783135486.321450:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135486.321455:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135486.321458:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135486.321460:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135486.321515:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809122688:0@lo:400:kworker.0 00010000:00080000:0.0:1783135486.321539:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b192a00 x1869752809123200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135486.321551:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b192a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809123200:0@lo:400:kworker.0 00010000:00080000:0.0:1783135486.321562:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e0380 x1869752809123712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135486.321570:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809123712:0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.321580:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809122816:0@lo:400:kworker.0 00010000:00080000:0.0:1783135486.321591:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b193100 x1869752809123328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135486.321600:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809123328:0@lo:400:kworker.0 00010000:00080000:0.0:1783135486.321610:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e1500 x1869752809123840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135486.321618:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809123840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.322057:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.322108:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809122944:0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.322145:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.322164:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809123456:0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.322186:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.322202:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809123968:0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.322222:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.322248:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809122560:0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.322277:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809123072:0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.322288:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809123584:0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.322317:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809123456 00000100:00100000:2.0:1783135486.322321:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809123456 00000100:00100000:2.0:1783135486.322365:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809123968 00000100:00100000:2.0:1783135486.322376:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809123968 00000100:00100000:2.0:1783135486.322401:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783135486.322409:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809123456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.322462:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809123456:12345-0@lo:400:kworker.0 Request processed in 54us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.322468:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783135486.322596:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135486.322604:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809123968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.322634:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809123968:12345-0@lo:400:kworker.0 Request processed in 32us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.322640:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1783135486.322659:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135486.322664:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135486.322672:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809122944 00000100:00100000:2.0:1783135486.322675:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809122944 00000100:00100000:2.0:1783135486.322701:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783135486.322708:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809122944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135486.322752:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809122944:12345-0@lo:400:kworker.0 Request processed in 45us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.322758:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783135486.322793:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809122944:0@lo:400:kworker.0 00010000:00080000:2.0:1783135486.322804:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b192300 x1869752809123456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135486.322811:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809123456:0@lo:400:kworker.0 00010000:00080000:2.0:1783135486.322820:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e3480 x1869752809123968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135486.322839:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809123968:0@lo:400:kworker.0 00000001:00100000:1.0:1783135486.325149:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000100:00100000:0.0:1783135486.325229:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809122432 00000100:00100000:0.0:1783135486.325240:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809122432 00000100:00100000:0.0:1783135486.325312:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1783135486.325321:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809122432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135486.325640:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809122432:12345-0@lo:400:kworker.0 Request processed in 319us (3582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.325648:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1783135486.327070:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809122432:0@lo:400:kworker.0 00000001:00100000:2.0:1783135486.327420:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000100:00100000:0.0:1783135486.328076:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135486.328109:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809124096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135486.328178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135486.328229:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809124096 00000100:00100000:0.0:1783135486.328236:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809124096 00000100:00100000:2.0:1783135486.328507:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809124224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135486.328542:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.328563:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135486.328569:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809124352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135486.328590:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.328613:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809124352 00000100:00100000:2.0:1783135486.328616:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809124352 00000100:00100000:1.0:1783135486.328702:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135486.328711:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809124480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135486.328881:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135486.328892:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809124096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135486.328922:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135486.329006:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783135486.329014:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809124352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135486.329026:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135486.329070:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809124352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.329078:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1783135486.329138:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e2680 x1869752809124352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135486.329157:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809124352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135486.329181:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809124224 00000100:00100000:2.0:1783135486.329185:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809124224 00000100:00100000:2.0:1783135486.329210:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783135486.329216:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809124224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135486.329242:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783135486.329459:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809124096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 570us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.329466:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1783135486.330038:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6412a8e00 x1869752809124096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135486.330056:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809124096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135486.330535:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809124224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1315us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.330554:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783135486.330601:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809124224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135486.332920:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135486.332960:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809124608:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1783135486.337064:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000001:00100000:3.0:1783135486.338211:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000100:00100000:1.0:1783135486.340169:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135486.340939:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.347401:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809124480 00000100:00100000:2.0:1783135486.347419:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809124480 00000100:00100000:2.0:1783135486.347514:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809124608 00000100:00100000:2.0:1783135486.347518:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809124608 00000100:00100000:2.0:1783135486.347539:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135486.347548:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809124480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135486.347588:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135486.347702:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809124480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (17779us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.347709:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135486.347727:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1783135486.348006:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e1880 x1869752809124480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135486.348027:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809124480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135486.348230:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809124608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135486.348245:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135486.348460:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809124608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 726us (7534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.348468:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1783135486.348615:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac541d9a300 x1869752809124608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135486.348630:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809124608:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783135486.830337:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135487.855881:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135488.881592:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135489.269638:0:12201:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1783135489.391434:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809124736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135489.391515:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135489.391614:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809124736 00000100:00100000:2.0:1783135489.391622:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809124736 00000100:00100000:2.0:1783135489.391674:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135489.391684:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809124736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783135489.391731:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135489.391782:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809124736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.391790:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135489.391851:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809124736:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135489.903343:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135490.625486:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135490.625528:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135490.625564:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135490.625595:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135490.625624:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785977088 00000100:00100000:3.0:1783135490.625633:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785977088 00000100:00100000:3.0:1783135490.625691:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785977344 00000100:00100000:3.0:1783135490.625694:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785977344 00000100:00100000:3.0:1783135490.625716:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 170 00000100:00100000:3.0:1783135490.625726:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785977088:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135490.625887:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785977088:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 161us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135490.625895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 170 00000100:00100000:3.0:1783135490.625915:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 171 00000100:00100000:3.0:1783135490.625922:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785977344:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135490.625946:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785977344:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135490.625952:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 171 00000100:00100000:3.0:1783135490.625973:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785977600 00000100:00100000:3.0:1783135490.625976:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785977600 00000100:00100000:3.0:1783135490.626004:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:3.0:1783135490.626010:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785977600:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135490.626036:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785977600:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135490.626042:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00080000:3.0:1783135490.626058:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135490.626063:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135490.626482:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785976960 00000100:00100000:2.0:1783135490.626487:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785976960 00000100:00100000:2.0:1783135490.626516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 311 00000100:00100000:2.0:1783135490.626523:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac641681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2401:x1869752785976960:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135490.626565:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac641681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2401:x1869752785976960:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 43us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135490.626571:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 311 00000100:00100000:0.0:1783135490.636040:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135490.636081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135490.636131:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135490.636160:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785977216 00000100:00100000:0.0:1783135490.636170:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785977216 00000100:00100000:0.0:1783135490.636278:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785977472 00000100:00100000:0.0:1783135490.636291:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785977472 00000100:00100000:0.0:1783135490.636321:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 172 00000100:00100000:0.0:1783135490.636331:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752785977216:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135490.636418:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752785977216:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 88us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135490.636425:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 172 00000100:00100000:0.0:1783135490.636443:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 173 00000100:00100000:0.0:1783135490.636449:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752785977472:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135490.636475:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752785977472:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135490.636481:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 173 00000100:00100000:0.0:1783135490.636500:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785977728 00000100:00100000:0.0:1783135490.636504:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785977728 00000100:00100000:0.0:1783135490.636531:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:0.0:1783135490.636538:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752785977728:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135490.636563:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752785977728:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135490.636570:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00080000:0.0:1783135490.636586:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135490.636591:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783135490.929128:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135491.439061:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135491.439109:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809124864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135491.439188:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135491.439280:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809124864 00000100:00100000:1.0:1783135491.439288:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809124864 00000100:00100000:1.0:1783135491.439355:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783135491.439367:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809124864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135491.439830:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135491.439893:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809124864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 529us (705us total) trans 0 rc 0/0 00000100:00080000:0.0:1783135491.440131:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783135491.440171:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6412ab480 x1869752809124864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135491.440190:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809124864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135491.440368:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783135491.440668:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809124992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135491.440707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135491.440741:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135491.440746:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809125120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135491.440768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135491.440792:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809124992 00000100:00100000:2.0:1783135491.440796:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809124992 00000100:00100000:2.0:1783135491.440829:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783135491.440836:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809124992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135491.440863:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783135491.440916:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809124992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135491.440922:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783135491.440967:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809124992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135491.440998:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809125120 00000100:00100000:2.0:1783135491.441001:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809125120 00000100:00100000:2.0:1783135491.441028:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783135491.441033:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809125120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135491.441045:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135491.441074:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809125120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135491.441080:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1783135491.441114:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783135491.441130:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438e1500 x1869752809125120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135491.441142:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809125120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135491.441944:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135491.441956:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809125248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135491.441990:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135491.444767:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809125632:0@lo:400:kworker.0 00000100:00100000:3.0:1783135491.444842:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135491.444878:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809126144:0@lo:400:kworker.0 00000100:00100000:3.0:1783135491.444898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135491.445023:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809125248 00000100:00100000:2.0:1783135491.445031:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809125248 00000100:00100000:2.0:1783135491.445083:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783135491.445109:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809125248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135491.445140:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135491.445180:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809125248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (3189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135491.445187:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1783135491.445211:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135491.445221:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809125504:0@lo:400:kworker.0 00000100:00100000:3.0:1783135491.445707:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809125632 00000100:00100000:3.0:1783135491.445711:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809125632 00000100:00100000:3.0:1783135491.445737:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809126144 00000100:00100000:3.0:1783135491.445739:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809126144 00000100:00100000:3.0:1783135491.445761:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783135491.445768:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809125632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135491.445807:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809125632:12345-0@lo:400:kworker.0 Request processed in 40us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135491.445813:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783135491.445826:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783135491.445830:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809126144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135491.445853:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809126144:12345-0@lo:400:kworker.0 Request processed in 22us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135491.445857:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1783135491.445876:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135491.445889:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809125376:0@lo:400:kworker.0 00000100:00100000:0.0:1783135491.446147:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809125760:0@lo:400:kworker.0 00000100:00100000:0.0:1783135491.446181:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135491.446212:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809126272:0@lo:400:kworker.0 00000100:00100000:1.0:1783135491.446726:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809125760 00000100:00100000:1.0:1783135491.446734:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809125760 00000100:00100000:1.0:1783135491.446767:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783135491.446774:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809125760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135491.446831:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809125760:12345-0@lo:400:kworker.0 Request processed in 57us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135491.446838:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783135491.446892:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809125632:0@lo:400:kworker.0 00010000:00080000:1.0:1783135491.446920:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6412a9f80 x1869752809126144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135491.446931:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809126144:0@lo:400:kworker.0 00000100:00100000:2.0:1783135491.447189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135491.447225:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809126016:0@lo:400:kworker.0 00000100:00100000:2.0:1783135491.447438:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135491.447786:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809126528:0@lo:400:kworker.0 00000100:00100000:2.0:1783135491.447831:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135491.447875:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809126528 00000100:00100000:2.0:1783135491.447880:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809126528 00000100:00100000:2.0:1783135491.447941:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135491.447949:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809126528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135491.447989:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809126528:12345-0@lo:400:kworker.0 Request processed in 41us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135491.447996:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1783135491.448018:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783135491.448038:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6412a9c00 x1869752809126528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135491.448049:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809126528:0@lo:400:kworker.0 00000100:00100000:2.0:1783135491.448083:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809125504 00000100:00100000:2.0:1783135491.448109:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809125504 00000100:00100000:2.0:1783135491.448132:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809126016 00000100:00100000:2.0:1783135491.448135:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809126016 00000100:00100000:2.0:1783135491.448153:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783135491.448159:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809125504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135491.448196:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809125504:12345-0@lo:400:kworker.0 Request processed in 36us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135491.448202:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783135491.448212:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783135491.448218:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809126016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135491.448258:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809126016:12345-0@lo:400:kworker.0 Request processed in 39us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135491.448263:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:2.0:1783135491.448285:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135491.448303:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809125504:0@lo:400:kworker.0 00000100:00100000:2.0:1783135491.448313:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809126016:0@lo:400:kworker.0 00000100:00100000:0.0:1783135491.448440:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135491.448491:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809125760:0@lo:400:kworker.0 00000100:00100000:3.0:1783135491.448589:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135491.448625:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809125888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135491.448654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135491.448671:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809126400:0@lo:400:kworker.0 00000100:00100000:3.0:1783135491.448693:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783135491.448718:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438ad880 x1869752809125248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135491.448735:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809125248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135491.448757:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809126272 00000100:00100000:3.0:1783135491.448761:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809126272 00000100:00100000:3.0:1783135491.448793:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809126400 00000100:00100000:3.0:1783135491.448795:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809126400 00000100:00100000:3.0:1783135491.448809:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783135491.448815:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809126272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135491.448849:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809126272:12345-0@lo:400:kworker.0 Request processed in 34us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135491.448855:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783135491.448868:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783135491.448874:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809126400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135491.448903:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809126400:12345-0@lo:400:kworker.0 Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135491.448908:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:3.0:1783135491.448922:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135491.448924:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783135491.448937:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6412abb80 x1869752809126400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135491.448946:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809126400:0@lo:400:kworker.0 00000100:00100000:1.0:1783135491.449121:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809125888 00000100:00100000:1.0:1783135491.449125:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809125888 00000100:00100000:1.0:1783135491.449152:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783135491.449158:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809125888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135491.449174:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135491.449211:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809125888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135491.449217:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1783135491.449408:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e2d80 x1869752809125888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135491.449421:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809125888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135491.449818:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809125376 00000100:00100000:0.0:1783135491.449824:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809125376 00000100:00100000:0.0:1783135491.449862:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1783135491.449869:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809125376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135491.449952:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809125376:12345-0@lo:400:kworker.0 Request processed in 83us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135491.449959:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1783135491.450002:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809126272:0@lo:400:kworker.0 00000100:00100000:3.0:1783135491.451204:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809125376:0@lo:400:kworker.0 00010000:00010000:0.0:1783135491.953198:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135492.975426:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135494.008538:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135494.511593:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135494.511651:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809126656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135494.511748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135494.511819:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809126656 00000100:00100000:1.0:1783135494.511826:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809126656 00000100:00100000:1.0:1783135494.511882:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783135494.511891:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809126656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135494.511926:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135494.511983:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809126656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135494.512005:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783135494.512051:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809126656:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135495.028642:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135495.737170:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135495.737216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135495.737243:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135495.737283:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135495.737313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135495.737334:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135495.737361:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135495.737397:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785978496 00000100:00100000:2.0:1783135495.737407:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785978496 00000100:00100000:2.0:1783135495.737466:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785978624 00000100:00100000:2.0:1783135495.737469:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785978624 00000100:00100000:2.0:1783135495.737492:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:2.0:1783135495.737502:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785978496:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135495.737641:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785978496:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 140us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135495.737650:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:2.0:1783135495.737668:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:2.0:1783135495.737676:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785978624:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135495.737704:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785978624:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 29us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135495.737710:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:2.0:1783135495.737730:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785977856 00000100:00100000:2.0:1783135495.737733:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785977856 00000100:00100000:2.0:1783135495.737773:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 313 00000100:00100000:2.0:1783135495.737778:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785977856:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135495.737804:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785977856:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135495.737810:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 313 00000100:00100000:2.0:1783135495.738157:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785977984 00000100:00100000:2.0:1783135495.738163:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785977984 00000100:00100000:2.0:1783135495.738379:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785978240 00000100:00100000:2.0:1783135495.738383:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785978240 00000100:00100000:2.0:1783135495.738399:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785978112 00000100:00100000:2.0:1783135495.738402:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785978112 00000100:00100000:2.0:1783135495.738415:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785978368 00000100:00100000:2.0:1783135495.738418:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785978368 00000100:00100000:2.0:1783135495.738435:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 180 00000100:00100000:2.0:1783135495.738440:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785977984:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135495.738479:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785977984:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 37us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135495.738485:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 180 00000100:00100000:2.0:1783135495.738499:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 181 00000100:00100000:2.0:1783135495.738505:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785978240:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135495.738531:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785978240:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135495.738536:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 181 00000100:00100000:2.0:1783135495.738546:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 182 00000100:00100000:2.0:1783135495.738552:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785978112:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135495.738574:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785978112:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 22us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135495.738589:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 182 00000100:00100000:2.0:1783135495.738600:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 183 00000100:00100000:2.0:1783135495.738606:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785978368:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135495.738632:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785978368:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135495.738638:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 183 00000100:00080000:2.0:1783135495.738667:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783135495.738671:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135495.738673:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135495.738675:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783135496.046697:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135496.559155:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809126784:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.559231:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135496.559672:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809127040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135496.559745:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135496.561123:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809127040 00000100:00100000:2.0:1783135496.561137:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809127040 00000100:00100000:2.0:1783135496.561197:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783135496.561207:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809127040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135496.561240:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135496.561326:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809127040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135496.561334:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783135496.561444:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809127296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135496.561486:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.561512:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135496.561520:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809126912:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.561545:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.564176:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809126784 00000100:00100000:3.0:1783135496.564185:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809126784 00000100:00100000:3.0:1783135496.564264:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1783135496.564275:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809126784:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783135496.564297:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135496.564322:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809127552:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.564374:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809126784:12345-0@lo:400:kworker.0 Request processed in 101us (5142us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135496.564382:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1783135496.564427:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809127424:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.564460:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.564486:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809127936:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.564506:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.564522:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809128448:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.564543:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.564561:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783135496.564567:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809127808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135496.564609:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.564626:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809128320:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.564646:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.564672:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809127296 00000100:00100000:3.0:1783135496.564676:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809127296 00000100:00100000:3.0:1783135496.564703:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783135496.564710:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809127296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135496.564754:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135496.564790:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809127296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (3303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135496.564796:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783135496.564815:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809126912 00000100:00100000:3.0:1783135496.564818:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809126912 00000100:00100000:3.0:1783135496.564835:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809127424 00000100:00100000:3.0:1783135496.564838:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809127424 00000100:00100000:3.0:1783135496.564850:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809127936 00000100:00100000:3.0:1783135496.564852:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809127936 00000100:00100000:3.0:1783135496.564870:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809128448 00000100:00100000:3.0:1783135496.564872:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809128448 00000100:00100000:3.0:1783135496.564884:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809128320 00000100:00100000:3.0:1783135496.564886:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809128320 00000100:00100000:3.0:1783135496.564900:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1783135496.564906:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809126912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.564939:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809126912:12345-0@lo:400:kworker.0 Request processed in 33us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135496.564945:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1783135496.564958:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1783135496.564963:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809127424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135496.564983:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.564993:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809127424:12345-0@lo:400:kworker.0 Request processed in 31us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135496.564999:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783135496.565002:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809128064:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.565011:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783135496.565015:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809127936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135496.565022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135496.565033:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809128576:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.565038:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809127936:12345-0@lo:400:kworker.0 Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135496.565050:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1783135496.565053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.565060:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809128064 00000100:00100000:3.0:1783135496.565063:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809128064 00000100:00100000:3.0:1783135496.565078:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783135496.565082:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809128448:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1783135496.565115:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b191c00 x1869752809127040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135496.565129:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809128448:12345-0@lo:400:kworker.0 Request processed in 47us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135496.565133:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b191c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809127040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135496.565134:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783135496.565145:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783135496.565150:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809128320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135496.565155:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1783135496.565160:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809127168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135496.565174:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809128320:12345-0@lo:400:kworker.0 Request processed in 24us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135496.565179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.565180:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783135496.565190:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1783135496.565194:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809127680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135496.565196:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809128064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135496.565212:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.565217:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809128064:12345-0@lo:400:kworker.0 Request processed in 22us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135496.565223:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1783135496.565223:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809128192:0@lo:400:kworker.0 00000100:00100000:2.0:1783135496.565240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135496.565243:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809127808 00000100:00100000:3.0:1783135496.565258:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809127808 00000100:00100000:3.0:1783135496.565277:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809127168 00000100:00100000:3.0:1783135496.565280:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809127168 00000100:00100000:3.0:1783135496.565293:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809127680 00000100:00100000:3.0:1783135496.565295:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809127680 00000100:00100000:3.0:1783135496.565305:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783135496.565311:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809127808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135496.565340:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135496.565373:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809127808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135496.565378:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783135496.565390:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783135496.565396:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809127168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135496.565407:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135496.565433:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809127168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135496.565438:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783135496.565448:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783135496.565453:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809127680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135496.565462:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135496.565481:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809127680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 28us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135496.565485:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1783135496.565511:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543765c00 x1869752809127808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135496.565524:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809127808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135496.565535:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809128320:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.565543:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809127424:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.565552:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809127936:0@lo:400:kworker.0 00010000:00080000:3.0:1783135496.565561:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e2a00 x1869752809128448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135496.565577:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809128448:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.565618:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809126912:0@lo:400:kworker.0 00000100:00100000:3.0:1783135496.565632:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809127296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135496.565642:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809126784:0@lo:400:kworker.0 00000100:00100000:1.0:1783135496.565874:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809127552 00000100:00100000:1.0:1783135496.565879:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809127552 00000100:00100000:1.0:1783135496.565902:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783135496.565909:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809127552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135496.565947:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809127552:12345-0@lo:400:kworker.0 Request processed in 38us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135496.565953:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783135496.566039:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809128704:0@lo:400:kworker.0 00000100:00100000:2.0:1783135496.566063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135496.566118:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809127552:0@lo:400:kworker.0 00010000:00080000:2.0:1783135496.566129:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e1500 x1869752809128064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135496.566137:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809128064:0@lo:400:kworker.0 00010000:00080000:2.0:1783135496.566154:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c650380 x1869752809127168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135496.566165:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809127168:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1783135496.566174:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438ad880 x1869752809127680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135496.566183:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809127680:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783135496.566309:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135496.566319:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135496.566322:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783135496.566324:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135496.566455:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809128576 00000100:00100000:2.0:1783135496.566460:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809128576 00000100:00100000:1.0:1783135496.566591:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809128192 00000100:00100000:1.0:1783135496.566596:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809128192 00000100:00100000:1.0:1783135496.566615:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809128704 00000100:00100000:1.0:1783135496.566617:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809128704 00000100:00100000:1.0:1783135496.566630:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783135496.566636:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809128576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135496.566680:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809128576:12345-0@lo:400:kworker.0 Request processed in 43us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135496.566687:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783135496.566700:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783135496.566713:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809128192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135496.566743:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809128192:12345-0@lo:400:kworker.0 Request processed in 31us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135496.566749:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783135496.566760:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783135496.566766:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809128704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135496.566791:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643477100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809128704:12345-0@lo:400:kworker.0 Request processed in 25us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135496.566796:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1783135496.567014:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e1880 x1869752809128192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135496.567025:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809128192:0@lo:400:kworker.0 00010000:00080000:1.0:1783135496.567037:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6412a9880 x1869752809128704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135496.567051:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809128704:0@lo:400:kworker.0 00010000:00080000:1.0:1783135496.567061:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6412ab480 x1869752809128576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135496.567068:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809128576:0@lo:400:kworker.0 00010000:00010000:1.0:1783135497.070516:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135498.094335:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783135498.374822:0:12517:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783135498.376502:0:12517:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135499.118650:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135499.635982:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809128832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135499.636910:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135499.642292:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809128832 00000100:00100000:2.0:1783135499.642308:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809128832 00000100:00100000:2.0:1783135499.642375:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783135499.642386:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809128832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783135499.642424:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135499.642566:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809128832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 181us (5658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135499.642574:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783135499.642635:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809128832:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135500.142389:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783135500.780605:0:12615:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135500.780870:0:12615:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783135500.861415:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135500.861459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135500.861481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135500.861499:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135500.861519:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135500.861597:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135500.861628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135500.861665:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785979008 00000100:00100000:3.0:1783135500.861675:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785979008 00000100:00100000:3.0:1783135500.861724:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785979264 00000100:00100000:3.0:1783135500.861727:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785979264 00000100:00100000:3.0:1783135500.861739:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785978880 00000100:00100000:3.0:1783135500.861741:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785978880 00000100:00100000:3.0:1783135500.861752:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785979136 00000100:00100000:3.0:1783135500.861754:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785979136 00000100:00100000:3.0:1783135500.861771:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 190 00000100:00100000:3.0:1783135500.861780:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785979008:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135500.861858:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785979008:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 78us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135500.861882:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 190 00000100:00100000:3.0:1783135500.861902:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 191 00000100:00100000:3.0:1783135500.861908:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785979264:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135500.861934:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785979264:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135500.861940:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 191 00000100:00100000:3.0:1783135500.861950:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 192 00000100:00100000:3.0:1783135500.861956:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785978880:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135500.861979:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785978880:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135500.861985:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 192 00000100:00100000:3.0:1783135500.861996:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 193 00000100:00100000:3.0:1783135500.862003:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785979136:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135500.862042:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785979136:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 40us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135500.862048:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 193 00000100:00100000:3.0:1783135500.862077:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785979392 00000100:00100000:3.0:1783135500.862081:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785979392 00000100:00100000:3.0:1783135500.862137:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785979520 00000100:00100000:3.0:1783135500.862140:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785979520 00000100:00100000:3.0:1783135500.862159:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:3.0:1783135500.862178:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2397:x1869752785979392:12345-192.168.204.6@tcp:9:kworker.0 00000020:00000080:3.0:1783135500.862215:0:8620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edfab8 00000100:00080000:3.0:1783135500.862223:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8ac54390f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135500.862276:0:8620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783135500.862405:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+2:2397:x1869752785979392:12345-192.168.204.6@tcp:9:kworker.0 Request processed in 238us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135500.862412:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:3.0:1783135500.862424:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:3.0:1783135500.862431:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2397:x1869752785979520:12345-192.168.204.6@tcp:9:kworker.0 00000020:00000080:3.0:1783135500.862442:0:8620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edfabf 00000100:00080000:3.0:1783135500.862448:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8ac543929800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135500.862472:0:8620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1783135500.862544:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+2:2397:x1869752785979520:12345-192.168.204.6@tcp:9:kworker.0 Request processed in 112us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135500.862550:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00080000:3.0:1783135500.862567:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135500.862570:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135500.862573:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135500.862575:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783135500.862707:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135500.862714:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135500.863204:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785978752 00000100:00100000:1.0:1783135500.863211:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785978752 00000100:00100000:1.0:1783135500.863254:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 315 00000100:00100000:1.0:1783135500.863262:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752785978752:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135500.863302:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752785978752:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 42us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135500.863309:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 315 00010000:00010000:1.0:1783135501.173629:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135501.681669:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809128960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135501.681770:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135501.681849:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809128960 00000100:00100000:3.0:1783135501.681858:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809128960 00000100:00100000:3.0:1783135501.681909:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783135501.681917:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809128960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135501.681959:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135501.682005:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809128960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135501.682024:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783135501.682073:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809128960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135501.682319:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809129088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135501.682408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135501.682469:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809129088 00000100:00100000:0.0:1783135501.682473:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809129088 00000100:00100000:0.0:1783135501.682531:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783135501.682539:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809129088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135501.682571:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135501.682609:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809129088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135501.682616:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1783135501.682634:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783135501.682660:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b190e00 x1869752809129088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135501.682676:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809129088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135501.683651:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809129216:0@lo:400:kworker.0 00000100:00100000:1.0:1783135501.683705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135501.683825:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809129216 00000100:00100000:0.0:1783135501.683832:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809129216 00000100:00100000:0.0:1783135501.683873:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1783135501.683880:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809129216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135501.687068:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809129216:12345-0@lo:400:kworker.0 Request processed in 3179us (3354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135501.687084:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1783135501.687207:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809129216:0@lo:400:kworker.0 00000100:00100000:1.0:1783135501.687229:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809129728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135501.687307:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135501.687345:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135501.687352:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809129600:0@lo:400:kworker.0 00000100:00100000:0.0:1783135501.687377:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135501.687471:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809129728 00000100:00100000:1.0:1783135501.687482:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809129728 00000100:00100000:1.0:1783135501.687543:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783135501.687552:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809129728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135501.687580:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135501.687620:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809129728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135501.687627:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1783135501.687696:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b190e00 x1869752809129728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135501.687714:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809129728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135501.687731:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809130240:0@lo:400:kworker.0 00000100:00100000:3.0:1783135501.687753:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809129344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135501.687782:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135501.687871:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809129856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135501.687897:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135501.687912:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809130368:0@lo:400:kworker.0 00000100:00100000:3.0:1783135501.687929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135501.687945:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783135501.687950:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809129472:0@lo:400:kworker.0 00000100:00100000:3.0:1783135501.687971:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809130368 00000100:00100000:3.0:1783135501.687975:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809130368 00000100:00100000:3.0:1783135501.688001:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783135501.688007:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809130368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135501.688040:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809130368:12345-0@lo:400:kworker.0 Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135501.688046:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783135501.688066:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809129344 00000100:00100000:3.0:1783135501.688069:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809129344 00000100:00100000:3.0:1783135501.688080:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809129856 00000100:00100000:3.0:1783135501.688082:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809129856 00000100:00100000:3.0:1783135501.688125:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783135501.688131:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809129344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135501.688141:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135501.688182:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809129344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135501.688201:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783135501.688213:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135501.688218:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809129856:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135501.688220:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1783135501.688229:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135501.688245:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809130752:0@lo:400:kworker.0 00000100:00100000:3.0:1783135501.688253:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809129856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135501.688259:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1783135501.688272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135501.688274:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135501.688289:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809129984:0@lo:400:kworker.0 00000100:00100000:0.0:1783135501.688289:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783135501.688294:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809130112:0@lo:400:kworker.0 00000100:00100000:3.0:1783135501.688312:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135501.688326:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809130496:0@lo:400:kworker.0 00000100:00100000:0.0:1783135501.688326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135501.688343:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809130624:0@lo:400:kworker.0 00000100:00100000:0.0:1783135501.688365:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135501.688394:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809129600 00000100:00100000:0.0:1783135501.688398:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809129600 00000100:00100000:0.0:1783135501.688419:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809130240 00000100:00100000:0.0:1783135501.688421:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809130240 00000100:00100000:0.0:1783135501.688434:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809129472 00000100:00100000:0.0:1783135501.688436:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809129472 00000100:00100000:0.0:1783135501.688445:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809130112 00000100:00100000:0.0:1783135501.688447:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809130112 00000100:00100000:0.0:1783135501.688459:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809130624 00000100:00100000:0.0:1783135501.688461:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809130624 00000100:00100000:0.0:1783135501.688475:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1783135501.688481:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809129600:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783135501.688578:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135501.688582:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783135501.688585:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135501.688586:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135501.688628:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135501.688646:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809129600:12345-0@lo:400:kworker.0 Request processed in 165us (1268us total) trans 0 rc 0/0 00010000:00080000:3.0:1783135501.688649:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438ad880 x1869752809129344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135501.688653:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783135501.688664:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809129344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135501.688664:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809130496 00000100:00100000:0.0:1783135501.688666:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809130496 00010000:00080000:3.0:1783135501.688674:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b190a80 x1869752809129856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135501.688684:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809129856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135501.688685:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783135501.688690:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809130240:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783135501.688693:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e0e00 x1869752809130368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135501.688701:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809130368:0@lo:400:kworker.0 00000100:00100000:0.0:1783135501.688718:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809130240:12345-0@lo:400:kworker.0 Request processed in 27us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135501.688724:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1783135501.688732:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783135501.688738:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809129472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135501.688741:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1783135501.688745:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809130112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135501.688777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809129472:12345-0@lo:400:kworker.0 Request processed in 37us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135501.688783:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783135501.688796:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1783135501.688869:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809130112:12345-0@lo:400:kworker.0 Request processed in 122us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135501.688878:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809130624:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783135501.688900:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135501.688906:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809130624:12345-0@lo:400:kworker.0 Request processed in 29us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135501.688923:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809130112:0@lo:400:kworker.0 00010000:00080000:2.0:1783135501.688936:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e1500 x1869752809130624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135501.688944:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809130624:0@lo:400:kworker.0 00010000:00080000:2.0:1783135501.688952:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e2d80 x1869752809130240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135501.688962:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809130240:0@lo:400:kworker.0 00000100:00100000:2.0:1783135501.688970:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809129600:0@lo:400:kworker.0 00000100:00100000:1.0:1783135501.689874:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783135501.689888:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809130496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135501.689937:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809130496:12345-0@lo:400:kworker.0 Request processed in 54us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135501.689943:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783135501.690043:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783135501.690068:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1783135501.690200:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809130752 00000100:00100000:0.0:1783135501.690206:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809130752 00000100:00100000:0.0:1783135501.690235:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783135501.690242:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809130752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135501.690283:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809130752:12345-0@lo:400:kworker.0 Request processed in 42us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135501.690289:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1783135501.690687:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543765880 x1869752809130752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135501.690703:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543765880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809130752:0@lo:400:kworker.0 00000100:00100000:0.0:1783135501.690746:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809129984 00000100:00100000:0.0:1783135501.690750:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809129984 00000100:00100000:0.0:1783135501.690783:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783135501.690790:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809129984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135501.690901:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809129984:12345-0@lo:400:kworker.0 Request processed in 112us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135501.690908:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783135501.692260:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809129472:0@lo:400:kworker.0 00000100:00100000:2.0:1783135501.692274:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809129984:0@lo:400:kworker.0 00000100:00100000:2.0:1783135501.692286:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809130496:0@lo:400:kworker.0 00010000:00010000:2.0:1783135502.191281:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783135503.203714:0:12712:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135503.203979:0:12712:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135503.220532:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135504.243433:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135504.750569:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135504.750597:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809130880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135504.750735:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135504.750905:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809130880 00000100:00100000:0.0:1783135504.751066:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809130880 00000100:00100000:0.0:1783135504.751164:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783135504.751174:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809130880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135504.751225:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135504.755624:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809130880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4441us (4878us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135504.755641:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783135504.761512:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809130880:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135505.263654:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783135505.866413:0:12809:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783135505.866717:0:12809:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783135505.983780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135505.983821:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135505.983859:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135505.983886:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135505.983915:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785979776 00000100:00100000:3.0:1783135505.983924:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785979776 00000100:00100000:3.0:1783135505.983995:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785979904 00000100:00100000:3.0:1783135505.983998:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785979904 00000100:00100000:3.0:1783135505.984016:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785980160 00000100:00100000:3.0:1783135505.984018:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785980160 00000100:00100000:3.0:1783135505.984035:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 200 00000100:00100000:3.0:1783135505.984044:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785979776:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135505.984297:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785979648 00000100:00100000:2.0:1783135505.984302:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785979648 00000100:00100000:2.0:1783135505.984335:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 317 00000100:00100000:2.0:1783135505.984343:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785979648:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135505.984382:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785979648:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 40us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135505.984390:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 317 00000100:00100000:3.0:1783135505.984545:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785979776:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 501us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135505.984571:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 200 00000100:00100000:3.0:1783135505.984590:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 201 00000100:00100000:3.0:1783135505.984596:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785979904:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135505.984624:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785979904:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135505.984630:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 201 00000100:00100000:3.0:1783135505.984643:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 202 00000100:00100000:3.0:1783135505.984650:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785980160:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135505.984675:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785980160:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135505.984681:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 202 00000100:00080000:3.0:1783135505.984702:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135505.984706:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135505.991020:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135505.991713:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785980032 00000100:00100000:0.0:1783135505.991724:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785980032 00000100:00100000:1.0:1783135505.996494:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 203 00000100:00100000:1.0:1783135505.996510:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785980032:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135505.996609:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785980032:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 102us (5597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135505.996617:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 203 00000100:00080000:2.0:1783135505.997527:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783135506.291688:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783135506.297176:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000020:00000080:1.0:1783135506.297191:0:9520:0:(genops.c:906:class_export_put()) final put ffff8ac54392e000/eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000020:00000080:3.0:1783135506.298497:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac54392e000/eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 for lustre-OST0001 00000020:00000080:3.0:1783135506.298581:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac543929800 for lustre-OST0001 00000001:00100000:2.0:1783135506.302496:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000020:00000080:2.0:1783135506.302509:0:8431:0:(genops.c:906:class_export_put()) final put ffff8ac543909800/eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000020:00000080:1.0:1783135506.302607:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac543909800/eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 for lustre-OST0000 00000020:00000080:1.0:1783135506.302662:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac54390f000 for lustre-OST0000 00000100:00100000:3.0:1783135506.800688:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809131136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135506.800764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135506.800833:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135506.800840:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809131264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135506.800863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135506.800893:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809131136 00000100:00100000:3.0:1783135506.800901:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809131136 00000100:00100000:3.0:1783135506.800950:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809131264 00000100:00100000:3.0:1783135506.800954:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809131264 00000100:00100000:3.0:1783135506.800971:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783135506.800996:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809131136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135506.801030:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135506.801115:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809131136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135506.801122:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783135506.801139:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783135506.801146:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809131264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135506.801162:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1783135506.801365:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135506.801370:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135506.801479:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809131776:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.801513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135506.801536:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809132288:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.801558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135506.801575:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809132800:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.801595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135506.801613:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783135506.801618:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809131648:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.801646:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135506.801666:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809132160:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.801690:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135506.801709:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809132672:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.801745:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135506.801775:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809131776 00000100:00100000:0.0:1783135506.801780:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809131776 00000100:00100000:0.0:1783135506.801801:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809132288 00000100:00100000:0.0:1783135506.801804:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809132288 00000100:00100000:0.0:1783135506.801830:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809132800 00000100:00100000:0.0:1783135506.801834:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809132800 00000100:00100000:0.0:1783135506.801845:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809132672 00000100:00100000:0.0:1783135506.801848:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809132672 00000100:00100000:0.0:1783135506.801861:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1783135506.801866:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809131776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.801904:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809131776:12345-0@lo:400:kworker.0 Request processed in 38us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135506.801910:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1783135506.801923:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1783135506.801929:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809132288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.801953:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809132288:12345-0@lo:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135506.801960:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1783135506.801970:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783135506.801976:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809132800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.802000:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809132800:12345-0@lo:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135506.802006:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783135506.802016:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783135506.802022:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809132672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.802047:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809132672:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135506.802069:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1783135506.802133:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809131648 00000100:00100000:0.0:1783135506.802136:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809131648 00000100:00100000:0.0:1783135506.802164:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1783135506.802187:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809131648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.802222:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809131648:12345-0@lo:400:kworker.0 Request processed in 36us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135506.802228:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1783135506.802257:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809132160 00000100:00100000:0.0:1783135506.802260:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809132160 00000100:00100000:0.0:1783135506.802283:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783135506.802289:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809132160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.802326:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809132160:12345-0@lo:400:kworker.0 Request processed in 37us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135506.802332:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1783135506.802357:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135506.802360:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135506.802384:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809131648:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.802398:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809132160:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.802408:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809132672:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.802417:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809131776:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.802425:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809132288:0@lo:400:kworker.0 00010000:00080000:0.0:1783135506.802438:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc5500 x1869752809132800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135506.802449:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809132800:0@lo:400:kworker.0 00010000:00080000:0.0:1783135506.802508:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c60f800 x1869752809131136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135506.802535:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809131136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135506.802878:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809131392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135506.802914:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135506.802942:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809131904:0@lo:400:kworker.0 00000100:00100000:1.0:1783135506.802963:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135506.802979:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809132416:0@lo:400:kworker.0 00000100:00100000:1.0:1783135506.802997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135506.803013:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809132928:0@lo:400:kworker.0 00000100:00100000:1.0:1783135506.803035:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135506.803065:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1783135506.803073:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809131008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135506.803127:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135506.803145:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809131520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135506.803165:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135506.803192:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809132032:0@lo:400:kworker.0 00000100:00100000:1.0:1783135506.803226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135506.803245:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809132544:0@lo:400:kworker.0 00000100:00100000:1.0:1783135506.803266:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135506.803292:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809131392 00000100:00100000:1.0:1783135506.803296:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809131392 00000100:00100000:1.0:1783135506.803318:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809131904 00000100:00100000:1.0:1783135506.803320:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809131904 00000100:00100000:1.0:1783135506.803333:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783135506.803338:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1869752809131392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783135506.803363:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783135506.803403:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1869752809131392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135506.803410:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1783135506.803425:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783135506.803431:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809131904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135506.803459:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809131904:12345-0@lo:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135506.803465:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1783135506.803483:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809131008 00000100:00100000:1.0:1783135506.803486:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809131008 00000100:00100000:1.0:1783135506.803513:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809131520 00000100:00100000:1.0:1783135506.803516:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809131520 00000100:00100000:1.0:1783135506.803530:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783135506.803535:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809131008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135506.803551:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135506.803579:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809131008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135506.803596:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783135506.803609:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783135506.803614:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809131520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135506.803627:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135506.803652:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809131520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135506.803657:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783135506.803675:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809132416 00000100:00100000:1.0:1783135506.803678:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809132416 00000100:00100000:1.0:1783135506.803703:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809132032 00000100:00100000:1.0:1783135506.803706:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809132032 00000100:00100000:1.0:1783135506.803724:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783135506.803729:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809132416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135506.803759:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809132416:12345-0@lo:400:kworker.0 Request processed in 29us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135506.803764:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783135506.803774:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1783135506.803780:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809132032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135506.803804:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809132032:12345-0@lo:400:kworker.0 Request processed in 24us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135506.803810:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:1.0:1783135506.803827:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135506.803832:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135506.803833:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783135506.803857:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc6680 x1869752809131008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135506.803884:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809131008:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1783135506.803896:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc4000 x1869752809131520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135506.803908:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809131520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135506.803916:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809132032:0@lo:400:kworker.0 00000100:00100000:1.0:1783135506.803927:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809131392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135506.803936:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809131904:0@lo:400:kworker.0 00010000:00080000:1.0:1783135506.803944:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc5180 x1869752809132416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135506.803952:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809132416:0@lo:400:kworker.0 00000100:00100000:3.0:1783135506.804467:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809132928 00000100:00100000:3.0:1783135506.804474:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809132928 00000100:00100000:3.0:1783135506.804518:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809132544 00000100:00100000:3.0:1783135506.804522:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809132544 00000100:00100000:3.0:1783135506.804544:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783135506.804551:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809132928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135506.804598:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809132928:12345-0@lo:400:kworker.0 Request processed in 48us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135506.804604:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783135506.804616:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783135506.804622:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809132544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135506.804661:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809132544:12345-0@lo:400:kworker.0 Request processed in 39us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135506.804667:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1783135506.804703:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc7480 x1869752809132544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135506.804713:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809132544:0@lo:400:kworker.0 00010000:00080000:3.0:1783135506.804723:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc4380 x1869752809132928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135506.804740:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809132928:0@lo:400:kworker.0 00000100:00100000:0.0:1783135506.805073:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809131264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3925us (4206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135506.805081:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1783135506.805174:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e1f80 x1869752809131264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135506.805189:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809131264:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1783135507.310204:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783135508.298302:0:12907:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135508.298543:0:12907:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783135508.337251:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135509.359287:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135509.870351:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135509.870384:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809133056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135509.870465:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135509.870646:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809133056 00000100:00100000:1.0:1783135509.870655:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809133056 00000100:00100000:1.0:1783135509.870726:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1783135509.870737:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809133056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135509.870775:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135509.870843:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809133056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135509.870851:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783135509.871838:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809133056:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783135510.382998:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135511.099466:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135511.099498:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135511.099524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135511.099543:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135511.099571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135511.099596:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785980416 00000100:00100000:3.0:1783135511.099606:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785980416 00000100:00100000:3.0:1783135511.099651:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785980672 00000100:00100000:3.0:1783135511.099653:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785980672 00000100:00100000:3.0:1783135511.099663:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785980544 00000100:00100000:3.0:1783135511.099666:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785980544 00000100:00100000:3.0:1783135511.099675:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785980800 00000100:00100000:3.0:1783135511.099677:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785980800 00000100:00100000:3.0:1783135511.099692:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 210 00000100:00100000:3.0:1783135511.099702:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785980416:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135511.099775:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752785980416:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 74us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.099801:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 210 00000100:00100000:3.0:1783135511.099819:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 211 00000100:00100000:3.0:1783135511.099826:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785980672:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135511.099850:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785980672:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.099856:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 211 00000100:00100000:3.0:1783135511.099867:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 212 00000100:00100000:3.0:1783135511.099873:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785980544:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135511.099894:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785980544:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 22us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.099900:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 212 00000100:00100000:3.0:1783135511.099910:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 213 00000100:00100000:3.0:1783135511.099916:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785980800:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135511.099940:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785980800:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.099946:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 213 00000100:00100000:3.0:1783135511.099965:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785980288 00000100:00100000:3.0:1783135511.099969:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785980288 00000100:00100000:3.0:1783135511.102413:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 319 00000100:00100000:3.0:1783135511.102433:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752785980288:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135511.102511:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752785980288:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 84us (2985us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.102519:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 319 00000100:00080000:3.0:1783135511.102574:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135511.102579:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783135511.406436:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135511.918450:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809133312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135511.918550:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135511.918625:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135511.918633:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809133184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135511.918660:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135511.924198:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809133312 00000100:00100000:3.0:1783135511.924215:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809133312 00000100:00100000:3.0:1783135511.925951:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809133184 00000100:00100000:3.0:1783135511.925973:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809133184 00000100:00100000:3.0:1783135511.928576:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783135511.928605:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809133312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135511.928649:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135511.928748:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809133312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (10197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.928756:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783135511.928779:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783135511.928787:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809133184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135511.928805:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135511.928834:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809133184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (10172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.928840:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1783135511.928881:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135511.928886:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783135511.931001:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434e3800 x1869752809133184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135511.931055:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809133184:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1783135511.931072:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b190a80 x1869752809133312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135511.931085:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809133312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135511.931748:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809133440:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.931832:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.931946:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135511.931953:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809133568:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.931997:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.932029:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809133568 00000100:00100000:0.0:1783135511.932036:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809133568 00000100:00100000:0.0:1783135511.932082:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783135511.932113:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809133568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932166:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809133568:12345-0@lo:400:kworker.0 Request processed in 54us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.932173:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1783135511.932210:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809133568:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932263:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809133696:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932291:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.932332:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135511.932339:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809133824:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932361:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.932403:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809133824 00000100:00100000:0.0:1783135511.932407:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809133824 00000100:00100000:0.0:1783135511.932432:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1783135511.932438:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809133824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932473:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809133824:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.932479:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1783135511.932506:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809133824:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932535:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809133952:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932558:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.932585:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809133696 00000100:00100000:0.0:1783135511.932589:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809133696 00000100:00100000:0.0:1783135511.932606:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809133952 00000100:00100000:0.0:1783135511.932609:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809133952 00000100:00100000:0.0:1783135511.932622:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783135511.932628:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809133696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932664:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809133696:12345-0@lo:400:kworker.0 Request processed in 35us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.932671:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783135511.932682:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783135511.932689:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809133952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932718:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809133952:12345-0@lo:400:kworker.0 Request processed in 31us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.932724:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783135511.932747:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809133952:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932767:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809133696:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932811:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135511.932818:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809134080:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932841:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.932861:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809134080 00000100:00100000:0.0:1783135511.932864:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809134080 00000100:00100000:0.0:1783135511.932894:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1783135511.932901:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809134080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.932931:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809134080:12345-0@lo:400:kworker.0 Request processed in 29us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.932936:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1783135511.932977:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809134080:0@lo:400:kworker.0 00000100:00080000:0.0:1783135511.932993:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135511.933017:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809134208:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.933040:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.933062:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809134208 00000100:00100000:0.0:1783135511.933066:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809134208 00000100:00100000:0.0:1783135511.933129:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1783135511.933136:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809134208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.933169:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809134208:12345-0@lo:400:kworker.0 Request processed in 33us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.933174:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00010000:00080000:0.0:1783135511.933200:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543adb100 x1869752809134208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135511.933211:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809134208:0@lo:400:kworker.0 00000100:00080000:0.0:1783135511.933223:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135511.933253:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135511.933261:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809134336:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.933288:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.933316:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809134336 00000100:00100000:0.0:1783135511.933320:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809134336 00000100:00100000:0.0:1783135511.933351:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783135511.933357:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809134336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.933391:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809134336:12345-0@lo:400:kworker.0 Request processed in 34us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.933396:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1783135511.933421:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543adb100 x1869752809134336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135511.933430:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809134336:0@lo:400:kworker.0 00000100:00080000:0.0:1783135511.933442:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135511.933462:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809134464:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.933483:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.933506:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809134464 00000100:00100000:0.0:1783135511.933509:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809134464 00000100:00100000:0.0:1783135511.933534:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1783135511.933540:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809134464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.933573:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809134464:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.933578:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1783135511.933603:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809134464:0@lo:400:kworker.0 00000100:00080000:0.0:1783135511.933615:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135511.933634:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135511.933647:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809134592:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.933672:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.933693:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809134592 00000100:00100000:0.0:1783135511.933697:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809134592 00000100:00100000:0.0:1783135511.933723:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783135511.933728:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809134592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.933759:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809134592:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.933765:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00080000:0.0:1783135511.933787:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543adb100 x1869752809134592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135511.933797:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809134592:0@lo:400:kworker.0 00000100:00080000:0.0:1783135511.933808:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135511.933832:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809134720:0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.933854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.933882:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809134720 00000100:00100000:0.0:1783135511.933885:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809134720 00000100:00100000:0.0:1783135511.933916:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783135511.933922:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809134720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135511.933978:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809134720:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.933985:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1783135511.934008:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543adb100 x1869752809134720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135511.934017:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809134720:0@lo:400:kworker.0 00000100:00080000:0.0:1783135511.934029:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135511.934124:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135511.934132:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809134848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135511.934157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.934181:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809134848 00000100:00100000:0.0:1783135511.934185:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809134848 00000100:00100000:0.0:1783135511.934203:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783135511.934209:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809134848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135511.934238:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783135511.934274:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809134848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.934280:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783135511.934308:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809134848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135511.935265:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809134976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135511.935276:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809133440 00000100:00100000:3.0:1783135511.935282:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809133440 00000100:00100000:2.0:1783135511.935314:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135511.935319:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1783135511.935328:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809133440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135511.935410:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809135104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135511.935451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135511.935499:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809134976 00000100:00100000:1.0:1783135511.935504:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809134976 00000100:00100000:1.0:1783135511.935527:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809135104 00000100:00100000:1.0:1783135511.935530:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809135104 00000100:00100000:1.0:1783135511.935543:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783135511.935549:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809134976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135511.935564:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135511.950908:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783135511.950936:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809135104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135511.950988:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135511.951102:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809135104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 165us (15633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.951111:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1783135511.951179:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543adb100 x1869752809135104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135511.951200:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809135104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135511.956819:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809133440:12345-0@lo:400:kworker.0 Request processed in 21481us (24977us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.956836:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1783135511.966380:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809134976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30819us (31054us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135511.966397:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1783135511.979141:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434f5180 x1869752809134976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135511.979167:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809134976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135511.979183:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809133440:0@lo:400:kworker.0 00010000:00010000:3.0:1783135512.433458:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135513.281608:0:13052:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783135513.460596:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135514.486535:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135514.991377:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809135232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135514.991462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135514.991612:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809135232 00000100:00100000:1.0:1783135514.991621:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809135232 00000100:00100000:1.0:1783135514.991672:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1783135514.991683:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809135232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135514.992067:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135514.992319:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809135232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 637us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135514.992328:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1783135514.995848:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809135232:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783135515.509241:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135516.219843:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135516.219934:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135516.227806:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135516.227842:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135516.238493:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785981056 00000100:00100000:0.0:1783135516.238526:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785981056 00000100:00100000:0.0:1783135516.238555:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785980928 00000100:00100000:0.0:1783135516.238558:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785980928 00000100:00100000:0.0:1783135516.238620:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 321 00000100:00100000:0.0:1783135516.238631:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785980928:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135516.238715:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785980928:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 85us (10919us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135516.238724:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 321 00000100:00080000:0.0:1783135516.238771:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135516.238803:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785981312 00000100:00100000:0.0:1783135516.238806:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785981312 00000100:00100000:0.0:1783135516.238831:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 220 00000100:00100000:0.0:1783135516.238838:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785981056:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135516.238868:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785981056:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 31us (19251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135516.238875:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 220 00000100:00100000:0.0:1783135516.238902:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 221 00000100:00100000:0.0:1783135516.238908:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785981312:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135516.238947:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785981312:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 40us (19013us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135516.238953:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 221 00000100:00080000:0.0:1783135516.238967:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135516.239215:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135516.239651:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785981184 00000100:00100000:0.0:1783135516.239657:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785981184 00000100:00100000:0.0:1783135516.239695:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785981440 00000100:00100000:0.0:1783135516.239698:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785981440 00000100:00100000:0.0:1783135516.239711:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 222 00000100:00100000:0.0:1783135516.239727:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785981184:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135516.239762:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785981184:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 36us (11919us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135516.239769:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 222 00000100:00100000:0.0:1783135516.239781:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 223 00000100:00100000:0.0:1783135516.239787:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785981440:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135516.239807:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785981440:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 21us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135516.239812:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 223 00000100:00080000:2.0:1783135516.242810:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783135516.527005:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135517.038321:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809135360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135517.038394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135517.038483:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809135360 00000100:00100000:2.0:1783135517.038490:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809135360 00000100:00100000:2.0:1783135517.038560:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783135517.038571:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809135360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135517.038604:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135517.038648:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809135360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135517.038665:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1783135517.038685:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783135517.038721:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438b3800 x1869752809135360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135517.038739:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809135360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135517.039019:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135517.039030:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809135488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135517.039079:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135517.039135:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809135488 00000100:00100000:1.0:1783135517.039139:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809135488 00000100:00100000:1.0:1783135517.039167:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783135517.039173:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809135488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135517.039189:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135517.039216:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809135488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135517.039221:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1783135517.039233:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783135517.039247:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434f4e00 x1869752809135488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135517.039259:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809135488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135517.039700:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135517.039711:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809135616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135517.039743:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135517.039777:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809136000:0@lo:400:kworker.0 00000100:00100000:1.0:1783135517.039809:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135517.039830:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809136512:0@lo:400:kworker.0 00000100:00100000:0.0:1783135517.039885:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809135616 00000100:00100000:0.0:1783135517.039890:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809135616 00000100:00100000:0.0:1783135517.039922:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783135517.039931:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809135616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135517.039946:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135517.039958:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809135744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135517.039983:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809135616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135517.039990:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783135517.039996:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135517.040005:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809135744 00000100:00100000:0.0:1783135517.040010:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809135744 00000100:00100000:2.0:1783135517.040018:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809136256:0@lo:400:kworker.0 00000100:00100000:0.0:1783135517.040029:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783135517.040037:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809135744:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135517.040046:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1783135517.040047:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135517.040064:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809136768:0@lo:400:kworker.0 00000100:00100000:0.0:1783135517.040081:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809135744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135517.040109:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783135517.040124:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135517.040137:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809136128:0@lo:400:kworker.0 00010000:00080000:2.0:1783135517.040154:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543ad9c00 x1869752809135744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135517.040170:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809135744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135517.040175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135517.040191:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783135517.040199:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809135872:0@lo:400:kworker.0 00000100:00100000:0.0:1783135517.040204:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809136640:0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.040234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135517.040242:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135517.040264:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809136384:0@lo:400:kworker.0 00000100:00100000:0.0:1783135517.040269:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809137152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135517.040296:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135517.040312:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809136128 00000100:00100000:0.0:1783135517.040317:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809136128 00000100:00100000:2.0:1783135517.040324:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809136896:0@lo:400:kworker.0 00000100:00100000:0.0:1783135517.040337:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809136384 00000100:00100000:0.0:1783135517.040341:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809136384 00000100:00100000:2.0:1783135517.040351:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135517.040360:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783135517.040368:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809136128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.040383:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809136000 00000100:00100000:2.0:1783135517.040388:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809136000 00000100:00100000:0.0:1783135517.040409:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809136128:12345-0@lo:400:kworker.0 Request processed in 42us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135517.040416:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783135517.040432:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783135517.040438:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809136256 00000100:00100000:0.0:1783135517.040440:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809136384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.040444:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809136256 00000100:00100000:2.0:1783135517.040465:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809136640 00000100:00100000:2.0:1783135517.040468:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809136640 00000100:00100000:0.0:1783135517.040480:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809136384:12345-0@lo:400:kworker.0 Request processed in 42us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135517.040484:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809136896 00000100:00100000:2.0:1783135517.040488:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809136896 00000100:00100000:0.0:1783135517.040492:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783135517.040512:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783135517.040519:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809136000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135517.040550:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783135517.040560:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809136256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.040568:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809136000:12345-0@lo:400:kworker.0 Request processed in 48us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135517.040575:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1783135517.040595:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783135517.040599:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809136256:12345-0@lo:400:kworker.0 Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135517.040606:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809136640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135517.040612:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1783135517.040632:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1783135517.040641:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809136896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.040645:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809136640:12345-0@lo:400:kworker.0 Request processed in 41us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135517.040657:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783135517.040689:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809136896:12345-0@lo:400:kworker.0 Request processed in 49us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135517.040697:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:0.0:1783135517.040716:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135517.040720:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135517.040722:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135517.040723:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135517.040744:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809136768 00000100:00100000:2.0:1783135517.040749:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809136768 00000100:00100000:2.0:1783135517.040776:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783135517.040782:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809136768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.040810:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809136768:12345-0@lo:400:kworker.0 Request processed in 28us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135517.040816:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783135517.040832:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809135872 00000100:00100000:2.0:1783135517.040835:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809135872 00000100:00100000:2.0:1783135517.040992:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1783135517.041001:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809135872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.041034:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809135872:12345-0@lo:400:kworker.0 Request processed in 36us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135517.041047:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1783135517.041113:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135517.041146:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809136128:0@lo:400:kworker.0 00010000:00080000:2.0:1783135517.041161:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc7480 x1869752809136640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135517.041172:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809136640:0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.041196:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809137152 00000100:00100000:2.0:1783135517.041199:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809137152 00000100:00100000:2.0:1783135517.041225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783135517.041231:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809137152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135517.041258:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783135517.041293:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809137152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135517.041299:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783135517.041338:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809137152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135517.041362:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809135872:0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.041375:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809136384:0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.041391:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809136896:0@lo:400:kworker.0 00000100:00100000:2.0:1783135517.041406:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809136256:0@lo:400:kworker.0 00010000:00080000:2.0:1783135517.041420:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc5180 x1869752809136768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135517.041430:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809136768:0@lo:400:kworker.0 00000100:00100000:1.0:1783135517.041664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135517.041697:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809137024:0@lo:400:kworker.0 00000100:00100000:1.0:1783135517.041727:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135517.041754:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809136000:0@lo:400:kworker.0 00010000:00080000:1.0:1783135517.041766:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434f4e00 x1869752809135616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135517.041805:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809135616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135517.041854:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809136512 00000100:00100000:1.0:1783135517.041859:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809136512 00000100:00100000:1.0:1783135517.041916:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809137024 00000100:00100000:1.0:1783135517.041919:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809137024 00000100:00100000:1.0:1783135517.041955:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1783135517.041963:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809136512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135517.042013:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809136512:12345-0@lo:400:kworker.0 Request processed in 50us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135517.042020:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1783135517.042044:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783135517.042054:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809137024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135517.042118:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809137024:12345-0@lo:400:kworker.0 Request processed in 67us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135517.042125:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:1.0:1783135517.042149:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135517.042153:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135517.042174:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809136512:0@lo:400:kworker.0 00010000:00080000:1.0:1783135517.042184:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc7100 x1869752809137024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135517.042193:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809137024:0@lo:400:kworker.0 00010000:00010000:1.0:1783135517.556496:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783135518.248278:0:13200:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7b369590 20000000:00000080:1.0:1783135518.248297:0:13200:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac543b7a400 uarg=0000000000000000 20000000:01000000:1.0:1783135518.248348:0:13200:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783135518.248361:0:13200:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783135518.248367:0:13200:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783135518.248992:0:13201:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1783135518.249325:0:13200:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783135518.266799:0:13200:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783135518.266920:0:13200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.266941:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c51a400/0xf7de4ef628edfa5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa56 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.266950:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c51a200/0xf7de4ef628edfa6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa64 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.266958:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c65d400/0xf7de4ef628edfa79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa72 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.266965:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c526e00/0xf7de4ef628edfa87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfa80 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.266974:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfa8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b24 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.266981:0:13200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfaa3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b63 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.266989:0:13200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.267067:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfaa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b63 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.267082:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfaa3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b63 expref: 12 pid: 6515 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135518.267119:0:13200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137280:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135518.267226:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfa8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b24 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.267235:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfa8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b24 expref: 12 pid: 6515 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135518.267244:0:13200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137408:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135518.267274:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c526e00/0xf7de4ef628edfa87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edfa80 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.267282:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c526e00/0xf7de4ef628edfa87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edfa80 expref: 23 pid: 6517 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135518.267291:0:13200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137536:0@lo:104: 00000100:00100000:0.0:1783135518.267335:0:13200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135518.267371:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c65d400/0xf7de4ef628edfa79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edfa72 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.267379:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c65d400/0xf7de4ef628edfa79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edfa72 expref: 23 pid: 6517 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135518.267398:0:13200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137664:0@lo:104: 00000100:00100000:0.0:1783135518.267418:0:13200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135518.267436:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c51a200/0xf7de4ef628edfa6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edfa64 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.267458:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c51a200/0xf7de4ef628edfa6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edfa64 expref: 23 pid: 6516 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135518.267465:0:13200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137792:0@lo:104: 00000100:00100000:0.0:1783135518.267484:0:13200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135518.267498:0:13200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c51a400/0xf7de4ef628edfa5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edfa56 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.267506:0:13200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c51a400/0xf7de4ef628edfa5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edfa56 expref: 23 pid: 6515 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135518.267514:0:13200:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137920:0@lo:104: 00000100:00100000:0.0:1783135518.267529:0:13200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135518.267538:0:13200:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543af5300 going to sleep for 11 seconds 00000100:00100000:2.0:1783135518.267631:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809137536 00000100:00100000:2.0:1783135518.267640:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809137536 00000100:00100000:2.0:1783135518.267686:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809137664 00000100:00100000:2.0:1783135518.267689:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809137664 00000100:00100000:2.0:1783135518.267698:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809137792 00000100:00100000:2.0:1783135518.267700:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809137792 00000100:00100000:2.0:1783135518.267707:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809137920 00000100:00100000:2.0:1783135518.267709:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809137920 00000100:00100000:2.0:1783135518.267720:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783135518.267730:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:13200:x1869752809137536:12345-0@lo:104: 00010000:00010000:2.0:1783135518.267742:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.267803:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135518.267809:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:13200:x1869752809137536:12345-0@lo:104: Request processed in 81us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135518.267817:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783135518.267833:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135518.267848:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:13200:x1869752809137664:12345-0@lo:104: 00010000:00010000:2.0:1783135518.267856:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.267883:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783135518.267888:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:13200:x1869752809137664:12345-0@lo:104: Request processed in 50us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135518.267893:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135518.267903:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783135518.267908:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:13200:x1869752809137792:12345-0@lo:104: 00010000:00010000:2.0:1783135518.267921:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.267948:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783135518.267953:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:13200:x1869752809137792:12345-0@lo:104: Request processed in 45us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135518.267959:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783135518.267968:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135518.267973:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:13200:x1869752809137920:12345-0@lo:104: 00010000:00010000:2.0:1783135518.267980:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268008:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783135518.268012:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:13200:x1869752809137920:12345-0@lo:104: Request processed in 39us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135518.268018:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1783135518.268032:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783135518.268038:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268046:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65cc00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:2.0:1783135518.268050:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268060:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135518.268067:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135518.268078:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135518.268131:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268138:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135518.268154:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268162:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c65cc00/0xf7de4ef628edfa80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa87 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268176:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783135518.268179:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268184:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d200 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:2.0:1783135518.268187:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268195:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135518.268201:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135518.268206:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135518.268214:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268219:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135518.268230:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268237:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c65d200/0xf7de4ef628edfa72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa79 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268246:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135518.268249:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268254:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:2.0:1783135518.268257:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268264:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135518.268270:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135518.268278:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135518.268292:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268298:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135518.268312:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268319:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfa64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa6b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268327:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135518.268335:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268340:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527a00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:2.0:1783135518.268343:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268349:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135518.268355:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135518.268359:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135518.268372:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268377:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135518.268382:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268388:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfa56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfa5d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268400:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135518.268402:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135518.268403:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135518.268410:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135518.268415:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135518.268437:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809138048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135518.268471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135518.268513:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135518.268519:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809138176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135518.268547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135518.268575:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809138432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135518.268594:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135518.268610:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135518.268615:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809138304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135518.268633:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135518.268657:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809138048 00000100:00100000:2.0:1783135518.268661:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809138048 00010000:00010000:2.0:1783135518.268682:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c526e00/0xf7de4ef628edfa87 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfa80 expref: 24 pid: 6517 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135518.268704:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809138176 00000100:00100000:2.0:1783135518.268708:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809138176 00010000:00010000:2.0:1783135518.268718:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c65d400/0xf7de4ef628edfa79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfa72 expref: 25 pid: 6517 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135518.268731:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809138432 00000100:00100000:2.0:1783135518.268733:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809138432 00010000:00010000:2.0:1783135518.268744:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c51a400/0xf7de4ef628edfa5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfa56 expref: 26 pid: 6515 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135518.268755:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809138304 00000100:00100000:2.0:1783135518.268757:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809138304 00010000:00010000:2.0:1783135518.268767:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c51a200/0xf7de4ef628edfa6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfa64 expref: 27 pid: 6516 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135518.268778:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135518.268783:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+27:3646:x1869752809138048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135518.268804:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135518.268810:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c526e00/0xf7de4ef628edfa87 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfa80 expref: 27 pid: 6517 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268820:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c526e00/0xf7de4ef628edfa87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edfa80 expref: 27 pid: 6517 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268836:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135518.268874:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+27:3646:x1869752809138048:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135518.268881:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135518.268895:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783135518.268900:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+26:3646:x1869752809138176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135518.268920:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135518.268924:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c65d400/0xf7de4ef628edfa79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfa72 expref: 26 pid: 6517 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268933:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c65d400/0xf7de4ef628edfa79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edfa72 expref: 26 pid: 6517 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.268942:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135518.268959:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+26:3646:x1869752809138176:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135518.268965:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783135518.268975:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783135518.268980:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:3649:x1869752809138432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135518.268986:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135518.268990:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c51a400/0xf7de4ef628edfa5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfa56 expref: 25 pid: 6515 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.269002:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c51a400/0xf7de4ef628edfa5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edfa56 expref: 25 pid: 6515 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.269011:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135518.269031:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:3649:x1869752809138432:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135518.269037:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783135518.269047:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135518.269052:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809138304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135518.269059:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135518.269063:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c51a200/0xf7de4ef628edfa6b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfa64 expref: 24 pid: 6516 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.269071:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c51a200/0xf7de4ef628edfa6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edfa64 expref: 24 pid: 6516 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135518.269079:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135518.269141:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809138304:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (506us total) trans 0 rc 0/0 00010000:00010000:1.0:1783135518.269144:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135518.269150:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135518.269205:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809138304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135518.269213:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809138432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135518.269249:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809138176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135518.269256:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809138048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135518.269562:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c526e00/0xf7de4ef628edfa87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edfa80 expref: 23 pid: 6517 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135518.269574:0:13200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137536:0@lo:104: 00010000:00010000:0.0:1783135518.269584:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65d400/0xf7de4ef628edfa79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edfa72 expref: 22 pid: 6517 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135518.269592:0:13200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137664:0@lo:104: 00010000:00010000:0.0:1783135518.269601:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51a200/0xf7de4ef628edfa6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edfa64 expref: 21 pid: 6516 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135518.269897:0:13200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137792:0@lo:104: 00010000:00010000:0.0:1783135518.269923:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51a400/0xf7de4ef628edfa5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edfa56 expref: 20 pid: 6515 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135518.269932:0:13200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137920:0@lo:104: 00000100:00100000:1.0:1783135518.274566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135518.274582:0:13200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137280:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135518.274600:0:13200:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13200:1869752809137408:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135518.274619:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00010000:00010000:0.0:1783135518.274665:0:13200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135518.274797:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785981568 00000100:00100000:3.0:1783135518.274804:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785981568 00010000:00010000:3.0:1783135518.274861:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfaa3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b63 expref: 13 pid: 6515 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135518.274904:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785981696 00000100:00100000:3.0:1783135518.274907:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785981696 00010000:00010000:3.0:1783135518.274920:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfa8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b24 expref: 14 pid: 6515 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135518.274952:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:3.0:1783135518.274961:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+14:2400:x1869752785981568:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135518.274978:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135518.274984:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfaa3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b63 expref: 14 pid: 6515 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275006:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfaa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b63 expref: 14 pid: 6515 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275032:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfaa3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b63 expref: 14 pid: 6515 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275053:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135518.275148:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752785981568:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 187us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135518.275156:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:3.0:1783135518.275178:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:3.0:1783135518.275185:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac64887f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:2400:x1869752785981696:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135518.275214:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135518.275218:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfa8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b24 expref: 12 pid: 6515 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275226:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfa8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b24 expref: 12 pid: 6515 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275237:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfa8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b24 expref: 12 pid: 6515 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275248:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275256:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275272:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275280:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275286:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275293:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275299:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135518.275304:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275323:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275336:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135518.275345:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135518.275367:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac64887f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:2400:x1869752785981696:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 182us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135518.275375:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 45 00010000:00010000:0.0:1783135518.276635:0:13200:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.276651:0:13200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.276659:0:13200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628edfac6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135518.575298:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783135519.345953:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135519.345964:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac67e2d9800 from 7 10000000:01000000:0.0:1783135519.345971:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135519.346043:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135519.346058:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135519.346846:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135519.346904:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809138560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135519.347018:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135519.347148:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543af5300 going to sleep for 11 seconds 00000100:00100000:1.0:1783135519.348451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809138560 00000100:00100000:1.0:1783135519.348468:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809138560 00000100:00100000:1.0:1783135519.348547:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1783135519.348561:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809138560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135519.348589:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135519.348614:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51ba00/0xf7de4ef628edfad4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfacd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.348650:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51ba00/0xf7de4ef628edfad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfacd expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.348664:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51ba00/0xf7de4ef628edfad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfacd expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.348676:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51ba00, rc 0) 00000100:00100000:1.0:1783135519.348784:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809138560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135519.348793:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1783135519.348892:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809138560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135519.348912:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.348938:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135519.349046:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809138688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.349083:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135519.349141:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135519.349171:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809138688 00000100:00100000:1.0:1783135519.349174:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809138688 00000100:00100000:1.0:1783135519.349201:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1783135519.349208:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809138688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.352464:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809138688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3241us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135519.352483:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1783135519.352591:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809138688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.352657:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809138816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.352710:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135519.352745:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135519.352763:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809138816 00000100:00100000:1.0:1783135519.352770:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809138816 00000100:00100000:1.0:1783135519.352817:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1783135519.352841:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809138816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.352930:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809138816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135519.352936:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1783135519.352986:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809138816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783135519.353691:0:13220:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783135519.353774:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783135519.353796:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135519.353809:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.353836:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135519.353851:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135519.353854:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac67c2fd800 from 7 10000000:01000000:1.0:1783135519.353857:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135519.353896:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.353905:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.353915:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135519.353936:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809138944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.353984:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135519.354005:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135519.354023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809138944 00000100:00100000:1.0:1783135519.354028:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809138944 00000100:00100000:1.0:1783135519.354061:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1783135519.354069:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809138944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135519.354121:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135519.354140:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51b400/0xf7de4ef628edfae2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfadb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.354171:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51b400/0xf7de4ef628edfae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfadb expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.354184:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51b400/0xf7de4ef628edfae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfadb expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.354194:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b400, rc 0) 00000100:00100000:1.0:1783135519.354229:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809138944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135519.354236:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1783135519.354283:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809138944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135519.354298:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.354307:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135519.354362:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.354386:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135519.354400:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135519.354411:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809139072 00000100:00100000:1.0:1783135519.354415:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809139072 00000100:00100000:1.0:1783135519.354435:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1783135519.354441:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809139072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.354578:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809139072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135519.354586:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1783135519.354618:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.354644:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.354686:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135519.354699:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135519.354713:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809139200 00000100:00100000:1.0:1783135519.354717:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809139200 00000100:00100000:1.0:1783135519.354739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1783135519.354746:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809139200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135519.366438:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.366777:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809139200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 12026us (12085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135519.366793:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000040:00080000:1.0:1783135519.368546:0:13221:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783135519.368803:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783135519.368840:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135519.368866:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135519.368881:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135519.368895:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135519.368899:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac6743ed800 from 7 10000000:01000000:0.0:1783135519.368903:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135519.368957:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135519.368966:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135519.368980:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135519.369011:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135519.369158:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135519.369213:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543af5600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135519.369575:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809139328 00000100:00100000:1.0:1783135519.369585:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809139328 00000100:00100000:1.0:1783135519.369658:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1783135519.369670:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809139328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135519.369689:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135519.369706:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edfaf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfae9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.369737:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edfaf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfae9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.369764:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edfaf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfae9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135519.369774:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a800, rc 0) 00000100:00100000:1.0:1783135519.369847:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809139328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135519.369865:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1783135519.370129:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135519.370159:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135519.370169:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135519.370268:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135519.370305:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135519.370328:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135519.370516:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809139456 00000100:00100000:1.0:1783135519.370522:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809139456 00000100:00100000:1.0:1783135519.370563:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1783135519.370571:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809139456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.370718:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809139456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135519.370726:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1783135519.371009:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135519.371053:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135519.371134:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135519.371159:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135519.371277:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809139584 00000100:00100000:0.0:1783135519.371283:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809139584 00000100:00100000:0.0:1783135519.371319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1783135519.371327:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809139584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135519.371417:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809139584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135519.371424:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1783135519.371545:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783135519.372551:0:13222:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783135519.372811:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783135519.372861:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135519.372874:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135519.372887:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135519.372900:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135519.372903:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac64382e000 from 7 10000000:01000000:3.0:1783135519.372906:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135519.372946:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135519.372955:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135519.372965:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135519.373002:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135519.373070:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135519.373122:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135519.373633:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809139712 00000100:00100000:0.0:1783135519.373644:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809139712 00000100:00100000:0.0:1783135519.373740:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1783135519.373752:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809139712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135519.373768:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135519.373783:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfafe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfaf7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135519.373812:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfafe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfaf7 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135519.373834:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfafe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfaf7 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135519.373844:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d200, rc 0) 00000100:00100000:0.0:1783135519.373916:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809139712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135519.373924:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1783135519.374310:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135519.374329:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135519.374340:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135519.374434:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135519.374470:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135519.374920:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135519.375060:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809139840 00000100:00100000:1.0:1783135519.375068:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809139840 00000100:00100000:1.0:1783135519.375140:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1783135519.375157:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809139840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.375311:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809139840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135519.375319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1783135519.378992:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135519.379123:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135519.379239:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135519.379284:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439870c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135519.379460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809139968 00000100:00100000:1.0:1783135519.379469:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809139968 00000100:00100000:1.0:1783135519.379534:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1783135519.379544:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809139968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135519.379826:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809139968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 273us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135519.379844:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1783135519.380008:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b190a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809139968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783135519.381246:0:13223:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783135519.381961:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783135519.382003:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135519.382022:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135519.382037:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135519.606402:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135519.990692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135519.990853:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785981824 00000100:00100000:3.0:1783135519.990868:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785981824 00000100:00100000:3.0:1783135519.990943:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 335 00000100:00100000:3.0:1783135519.990966:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:6176:x1869752785981824:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135519.990989:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135519.991015:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfb05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140b94 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135519.991055:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfb05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b94 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135519.991078:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfb05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b94 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135519.991115:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526a00, rc 0) 00000100:00100000:3.0:1783135519.991201:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785981824:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 247us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135519.991210:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 335 00000100:00100000:3.0:1783135519.995795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135520.002870:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785981952 00000100:00100000:1.0:1783135520.002899:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785981952 00000100:00100000:1.0:1783135520.003801:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 336 00000100:00100000:1.0:1783135520.003828:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785981952:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135520.004109:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785981952:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 266us (8311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135520.004119:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 336 00000100:00100000:3.0:1783135520.009705:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135520.009752:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785982080 00000100:00100000:3.0:1783135520.009765:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785982080 00000100:00100000:3.0:1783135520.009840:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 337 00000100:00100000:3.0:1783135520.009853:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785982080:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135520.010337:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785982080:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 485us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135520.010359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 337 00000100:00100000:0.0:1783135520.023707:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135520.024325:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785982208 00000100:00100000:3.0:1783135520.024340:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785982208 00000100:00100000:3.0:1783135520.024497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 338 00000100:00100000:3.0:1783135520.024508:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785982208:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135520.024531:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135520.024555:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edfb0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140b9b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135520.024590:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edfb0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b9b expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135520.025033:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edfb0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b9b expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135520.025046:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526600, rc 0) 00000100:00100000:3.0:1783135520.025737:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:6176:x1869752785982208:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 1224us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135520.025748:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 338 00000100:00100000:3.0:1783135520.030341:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135520.034912:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785982336 00000100:00100000:1.0:1783135520.034934:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785982336 00000100:00100000:1.0:1783135520.035209:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 339 00000100:00100000:1.0:1783135520.035225:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:6176:x1869752785982336:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135520.035497:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:6176:x1869752785982336:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 275us (5170us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135520.035505:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 339 00000100:00100000:3.0:1783135520.040828:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135520.047440:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785982464 00000100:00100000:0.0:1783135520.047463:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785982464 00000100:00100000:0.0:1783135520.047573:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 340 00000100:00100000:0.0:1783135520.047586:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:6176:x1869752785982464:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135520.047849:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:6176:x1869752785982464:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 254us (7038us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135520.047860:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 340 00000100:00100000:3.0:1783135520.112349:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135520.112385:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809140096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135520.112491:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135520.112620:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809140096 00000100:00100000:0.0:1783135520.112631:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809140096 00000100:00100000:0.0:1783135520.112699:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783135520.112710:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809140096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135520.112758:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135520.113239:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809140096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135520.113598:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809140096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135520.113611:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00010000:2.0:1783135520.625904:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135521.346599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135521.346640:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135521.346670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135521.346690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135521.346712:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135521.346749:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785982720 00000100:00100000:3.0:1783135521.346763:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785982720 00000100:00100000:3.0:1783135521.346849:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785982976 00000100:00100000:3.0:1783135521.346852:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785982976 00000100:00100000:3.0:1783135521.346864:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785982848 00000100:00100000:3.0:1783135521.346867:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785982848 00000100:00100000:3.0:1783135521.346877:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785983104 00000100:00100000:3.0:1783135521.346879:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785983104 00000100:00100000:3.0:1783135521.346895:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 230 00000100:00100000:3.0:1783135521.346905:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785982720:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135521.347035:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785982720:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 129us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135521.347043:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 230 00000100:00100000:3.0:1783135521.347063:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 231 00000100:00100000:3.0:1783135521.347069:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785982976:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135521.347280:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785982976:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 211us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135521.347287:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 231 00000100:00100000:3.0:1783135521.347299:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 232 00000100:00100000:3.0:1783135521.347305:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785982848:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135521.347328:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785982848:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135521.347334:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 232 00000100:00100000:3.0:1783135521.347344:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 233 00000100:00100000:3.0:1783135521.347350:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785983104:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135521.347371:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785983104:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 21us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135521.347376:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 233 00000100:00100000:3.0:1783135521.347407:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785982592 00000100:00100000:3.0:1783135521.347411:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785982592 00000100:00100000:3.0:1783135521.347442:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 341 00000100:00100000:3.0:1783135521.347447:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752785982592:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135521.347471:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752785982592:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135521.347484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 341 00000100:00080000:3.0:1783135521.347534:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135521.347539:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783135521.660021:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135522.160797:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809140352:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.160916:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135522.160994:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809140864:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.161018:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135522.161042:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809141376:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.161063:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135522.161079:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809141888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135522.161123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135522.161166:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783135522.161173:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809140480:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.161195:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135522.161213:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809140992:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.161232:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135522.161248:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809141504:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.161266:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135522.161340:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809140352 00000100:00100000:1.0:1783135522.161351:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809140352 00000100:00100000:1.0:1783135522.161410:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809140864 00000100:00100000:1.0:1783135522.161414:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809140864 00000100:00100000:1.0:1783135522.161441:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809141376 00000100:00100000:1.0:1783135522.161443:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809141376 00000100:00100000:1.0:1783135522.161457:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809140992 00000100:00100000:1.0:1783135522.161459:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809140992 00000100:00100000:1.0:1783135522.161472:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809141504 00000100:00100000:1.0:1783135522.161474:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809141504 00000100:00100000:1.0:1783135522.161490:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1783135522.161499:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809140352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.164128:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809140352:12345-0@lo:400:kworker.0 Request processed in 2615us (3199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135522.164146:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1783135522.164191:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1783135522.164207:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809140864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.164272:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809140864:12345-0@lo:400:kworker.0 Request processed in 73us (3253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135522.164277:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1783135522.164286:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783135522.164300:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809141376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.164326:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809141376:12345-0@lo:400:kworker.0 Request processed in 26us (3262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135522.164331:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783135522.164341:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783135522.164347:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809140992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.164370:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809140992:12345-0@lo:400:kworker.0 Request processed in 24us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135522.164375:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783135522.164383:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783135522.164390:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809141504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.164418:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809141504:12345-0@lo:400:kworker.0 Request processed in 29us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135522.164424:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783135522.164464:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809141888 00000100:00100000:1.0:1783135522.164473:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809141888 00000100:00100000:1.0:1783135522.164508:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809140480 00000100:00100000:1.0:1783135522.164512:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809140480 00000100:00100000:1.0:1783135522.164524:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783135522.164530:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1869752809141888:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135522.168495:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809140224:0@lo:400:kworker.0 00000100:00100000:3.0:1783135522.168647:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135522.168717:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809140736:0@lo:400:kworker.0 00000100:00100000:3.0:1783135522.168751:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135522.168778:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809141248:0@lo:400:kworker.0 00000100:00100000:3.0:1783135522.168805:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135522.168839:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809141760:0@lo:400:kworker.0 00000100:00100000:3.0:1783135522.168865:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135522.168906:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1783135522.168913:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809140608:0@lo:400:kworker.0 00000100:00100000:3.0:1783135522.168940:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135522.168959:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809141120:0@lo:400:kworker.0 00000100:00100000:3.0:1783135522.168980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135522.169001:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809141632:0@lo:400:kworker.0 00000100:00100000:3.0:1783135522.169023:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135522.169040:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809142144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135522.169128:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135522.169250:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809140224 00000100:00100000:3.0:1783135522.169261:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809140224 00000100:00100000:3.0:1783135522.169328:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1783135522.169340:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809140224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135522.169420:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809140224:12345-0@lo:400:kworker.0 Request processed in 81us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135522.169428:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1783135522.169474:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809142272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135522.169497:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135522.169540:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809140224:0@lo:400:kworker.0 00000100:00100000:0.0:1783135522.169988:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809141248 00000100:00100000:0.0:1783135522.169995:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809141248 00000100:00100000:0.0:1783135522.170035:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809141760 00000100:00100000:0.0:1783135522.170039:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809141760 00000100:00100000:0.0:1783135522.170055:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809141120 00000100:00100000:0.0:1783135522.170058:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809141120 00000100:00100000:0.0:1783135522.170075:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809141632 00000100:00100000:0.0:1783135522.170079:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809141632 00000100:00100000:0.0:1783135522.170115:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135522.170124:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809141248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135522.170191:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809141248:12345-0@lo:400:kworker.0 Request processed in 68us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135522.170199:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135522.170213:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135522.170219:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809141760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135522.170249:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809141760:12345-0@lo:400:kworker.0 Request processed in 30us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135522.170255:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135522.170266:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135522.170271:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809141120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135522.170300:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809141120:12345-0@lo:400:kworker.0 Request processed in 29us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135522.170306:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135522.170317:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783135522.170323:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809141632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135522.170349:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809141632:12345-0@lo:400:kworker.0 Request processed in 26us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135522.170355:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783135522.170376:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809142144 00000100:00100000:0.0:1783135522.170380:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809142144 00000100:00100000:0.0:1783135522.170408:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809142272 00000100:00100000:0.0:1783135522.170412:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809142272 00000100:00100000:0.0:1783135522.170424:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783135522.170432:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809142144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135522.170461:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135522.170495:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809142144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135522.170509:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783135522.170521:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783135522.170527:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809142272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135522.170556:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135522.170585:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809142272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135522.170591:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000004:00000024:1.0:1783135522.172878:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783135522.172969:0:6527:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1783135522.172985:0:6527:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1783135522.173021:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809140608 00000100:00100000:1.0:1783135522.173029:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809140608 00000100:00100000:1.0:1783135522.173107:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783135522.173120:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809140608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.173242:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809140608:12345-0@lo:400:kworker.0 Request processed in 125us (4301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135522.173252:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:1.0:1783135522.173280:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135522.173286:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135522.173291:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135522.173294:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135522.173442:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809142400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135522.173495:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783135522.173555:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc6300 x1869752809140992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135522.173572:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809140992:0@lo:400:kworker.0 00010000:00080000:1.0:1783135522.173589:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543794e00 x1869752809141504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135522.173597:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809141504:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.173611:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809140352:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.173623:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809140864:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.173637:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809141376:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.173672:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135522.173679:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809142016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135522.173701:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135522.173732:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809142400 00000100:00100000:1.0:1783135522.173735:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809142400 00000100:00100000:1.0:1783135522.173755:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809142016 00000100:00100000:2.0:1783135522.175790:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135522.175823:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809142400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135522.175870:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135522.175980:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809142400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135522.175987:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135522.176235:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1869752809141888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 11703us (15109us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135522.176245:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783135522.176268:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809140736 00000100:00100000:2.0:1783135522.176276:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809140736 00000100:00100000:2.0:1783135522.176305:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783135522.176312:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809140480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135522.176352:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809140480:12345-0@lo:400:kworker.0 Request processed in 40us (15155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135522.176358:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783135522.176370:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783135522.176375:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809140736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135522.176404:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809140736:12345-0@lo:400:kworker.0 Request processed in 29us (7652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135522.176409:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:3.0:1783135522.176536:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3ea00 x1869752809142272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135522.176577:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809142272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135522.176597:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809140608:0@lo:400:kworker.0 00010000:00080000:3.0:1783135522.176610:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543794000 x1869752809141120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135522.176619:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809141120:0@lo:400:kworker.0 00010000:00080000:3.0:1783135522.176632:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543797100 x1869752809141632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135522.176639:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809141632:0@lo:400:kworker.0 00010000:00080000:3.0:1783135522.176653:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac541d90000 x1869752809142144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135522.176664:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809142144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135522.176677:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809140736:0@lo:400:kworker.0 00010000:00080000:3.0:1783135522.176686:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543794a80 x1869752809141248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135522.176714:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809141248:0@lo:400:kworker.0 00010000:00080000:3.0:1783135522.176727:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543794700 x1869752809141760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135522.176734:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809141760:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.177269:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809142016 00000100:00100000:1.0:1783135522.177312:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783135522.177321:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809142016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135522.177359:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135522.177418:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809142016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (3715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135522.177425:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1783135522.177461:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac541d92680 x1869752809142016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135522.177476:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809142016:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1783135522.177488:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3d500 x1869752809142400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135522.177500:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809142400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135522.177513:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809140480:0@lo:400:kworker.0 00000100:00100000:1.0:1783135522.177527:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809141888:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783135522.672898:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135523.250305:0:13400:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783135523.698105:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135524.721241:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135525.245341:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809142528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135525.245431:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135525.246345:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809142528 00000100:00100000:0.0:1783135525.246358:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809142528 00000100:00100000:0.0:1783135525.246424:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783135525.246435:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809142528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135525.246473:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135525.246649:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809142528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 215us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135525.246657:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783135525.246727:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809142528:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135525.742326:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135526.454442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135526.454490:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135526.454518:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135526.454743:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785983232 00000100:00100000:3.0:1783135526.454756:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785983232 00000100:00100000:3.0:1783135526.454831:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 343 00000100:00100000:3.0:1783135526.454843:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752785983232:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135526.454943:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752785983232:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 102us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135526.454951:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 343 00000100:00100000:0.0:1783135526.455643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135526.460594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135526.465284:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785983488 00000100:00100000:2.0:1783135526.465308:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785983488 00000100:00100000:2.0:1783135526.465424:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785983744 00000100:00100000:2.0:1783135526.465429:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785983744 00000100:00100000:2.0:1783135526.465445:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785983360 00000100:00100000:2.0:1783135526.465448:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785983360 00000100:00100000:2.0:1783135526.465460:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785983616 00000100:00100000:2.0:1783135526.465463:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785983616 00000100:00100000:2.0:1783135526.465490:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 240 00000100:00080000:0.0:1783135526.465493:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135526.465500:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135526.465501:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785983488:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135526.465525:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 241 00000100:00100000:0.0:1783135526.465535:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785983744:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135526.466055:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1783135526.466069:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1783135526.466283:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 242 00000100:00100000:3.0:1783135526.466292:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785983360:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135526.468117:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785983744:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 2577us (13589us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135526.468136:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 241 00000100:00100000:0.0:1783135526.468179:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1783135526.468192:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 243 00000100:00100000:0.0:1783135526.468206:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785983616:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135526.468277:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785983616:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 77us (7723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135526.468284:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 243 00000100:00100000:2.0:1783135526.468336:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785983488:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 2562us (13570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135526.468345:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 240 00000100:00100000:3.0:1783135526.474413:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752785983360:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 8103us (18754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135526.474432:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 242 00010000:00010000:1.0:1783135526.771878:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135527.281284:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809142912:0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.281370:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135527.281419:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809143424:0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.281571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135527.281593:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809143936:0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.281615:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135527.281639:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783135527.281644:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809143040:0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.281667:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135527.281696:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809143552:0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.281731:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135527.281747:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809144064:0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.281767:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135527.281808:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809143424 00000100:00100000:0.0:1783135527.281896:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809143424 00000100:00100000:0.0:1783135527.281948:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809143936 00000100:00100000:0.0:1783135527.281951:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809143936 00000100:00100000:0.0:1783135527.281974:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809143040 00000100:00100000:0.0:1783135527.281977:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809143040 00000100:00100000:0.0:1783135527.281995:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1783135527.282004:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809143424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.282075:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809143424:12345-0@lo:400:kworker.0 Request processed in 71us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135527.282083:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1783135527.282126:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783135527.282133:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809143936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.282294:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809143936:12345-0@lo:400:kworker.0 Request processed in 161us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135527.282300:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783135527.282313:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783135527.282321:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809143040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.282350:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809143040:12345-0@lo:400:kworker.0 Request processed in 31us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135527.282355:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783135527.282377:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809143552 00000100:00100000:0.0:1783135527.282381:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809143552 00000100:00100000:0.0:1783135527.282410:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809144064 00000100:00100000:0.0:1783135527.282420:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809144064 00000100:00100000:0.0:1783135527.282459:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783135527.282467:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809143552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.282499:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809143552:12345-0@lo:400:kworker.0 Request processed in 34us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135527.282505:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783135527.282516:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783135527.282523:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809144064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.282550:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809144064:12345-0@lo:400:kworker.0 Request processed in 29us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135527.282556:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1783135527.282576:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135527.282580:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135527.282582:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135527.282623:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809143040:0@lo:400:kworker.0 00010000:00080000:0.0:1783135527.282635:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543794700 x1869752809143552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135527.282645:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809143552:0@lo:400:kworker.0 00010000:00080000:0.0:1783135527.282655:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543797800 x1869752809144064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135527.282662:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809144064:0@lo:400:kworker.0 00010000:00080000:0.0:1783135527.282683:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543796680 x1869752809143424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135527.282691:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809143424:0@lo:400:kworker.0 00010000:00080000:0.0:1783135527.282701:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543794000 x1869752809143936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135527.282714:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809143936:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.283449:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809142784:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.283501:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135527.283534:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809143296:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.283557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135527.283575:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809143808:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.283610:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135527.283632:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1783135527.283639:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809142656:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.283680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135527.283708:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809143168:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.283733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135527.283751:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809143680:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.283772:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135527.283788:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809144192:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.283807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135527.283885:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809142912 00000100:00100000:3.0:1783135527.283891:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809142912 00000100:00100000:3.0:1783135527.283923:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809143168 00000100:00100000:3.0:1783135527.283927:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809143168 00000100:00100000:3.0:1783135527.283943:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783135527.283951:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809142912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.284002:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809142912:12345-0@lo:400:kworker.0 Request processed in 53us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135527.284010:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783135527.284025:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783135527.284030:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809143168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.284057:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809143168:12345-0@lo:400:kworker.0 Request processed in 27us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135527.284062:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783135527.284129:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809142656 00000100:00100000:3.0:1783135527.284132:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809142656 00000100:00100000:3.0:1783135527.284493:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1783135527.284501:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809142656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.284535:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809142656:12345-0@lo:400:kworker.0 Request processed in 35us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135527.284542:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1783135527.284578:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809144320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135527.284605:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135527.284641:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809142656:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.284654:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809143168:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.284704:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809142784 00000100:00100000:3.0:1783135527.284707:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809142784 00000100:00100000:3.0:1783135527.284731:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809143296 00000100:00100000:3.0:1783135527.284734:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809143296 00000100:00100000:3.0:1783135527.284757:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809143808 00000100:00100000:3.0:1783135527.284759:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809143808 00000100:00100000:3.0:1783135527.284773:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1783135527.284778:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809142784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.284827:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809142784:12345-0@lo:400:kworker.0 Request processed in 35us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135527.284833:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1783135527.284846:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1783135527.284852:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809143296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.284878:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809143296:12345-0@lo:400:kworker.0 Request processed in 27us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135527.284884:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1783135527.284895:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1783135527.284911:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809143808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.284942:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809143808:12345-0@lo:400:kworker.0 Request processed in 33us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135527.284949:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1783135527.284976:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809142784:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.284988:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809143296:0@lo:400:kworker.0 00000100:00100000:3.0:1783135527.284999:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809143808:0@lo:400:kworker.0 00000100:00080000:3.0:1783135527.285021:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135527.285961:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809143680 00000100:00100000:0.0:1783135527.285970:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809143680 00000100:00100000:0.0:1783135527.286013:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809144192 00000100:00100000:0.0:1783135527.286016:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809144192 00000100:00100000:0.0:1783135527.286035:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783135527.286042:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809143680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.286120:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809143680:12345-0@lo:400:kworker.0 Request processed in 79us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135527.286126:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783135527.286140:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783135527.286147:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809144192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.286190:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809144192:12345-0@lo:400:kworker.0 Request processed in 43us (2381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135527.286195:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783135527.286219:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135527.286232:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809144448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135527.286265:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135527.286324:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809142912:0@lo:400:kworker.0 00000100:00100000:0.0:1783135527.289412:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543be3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809144576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135527.289769:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809144704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135527.289932:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135527.290945:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135527.290975:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135527.290983:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809144832:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135527.291017:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135527.291076:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809144320 00000100:00100000:2.0:1783135527.291100:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809144320 00000100:00100000:2.0:1783135527.291148:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809144448 00000100:00100000:2.0:1783135527.291152:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809144448 00000100:00100000:0.0:1783135527.291281:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809144832 00000100:00100000:0.0:1783135527.291286:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809144832 00000100:00100000:0.0:1783135527.291324:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783135527.291333:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809144832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135527.291382:0:13344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783135527.291510:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809144832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 178us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135527.291519:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783135527.291705:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809144576 00000100:00100000:2.0:1783135527.291709:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809144576 00000100:00100000:2.0:1783135527.291719:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809144704 00000100:00100000:2.0:1783135527.291721:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809144704 00000100:00100000:2.0:1783135527.291732:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783135527.291737:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809144320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135527.291758:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135527.291792:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809144320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (7185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135527.291808:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783135527.291837:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783135527.291843:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809144448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135527.291859:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135527.291888:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809144448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (5622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135527.291894:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783135527.291903:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783135527.291908:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809144576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135527.291916:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135527.291938:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809144576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135527.291944:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1783135527.291954:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783135527.291961:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809144704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135527.291969:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135527.291993:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809144704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135527.291998:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783135527.292038:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809144832:0@lo:41:osp-pre-0-1.0 00010000:00080000:2.0:1783135527.292050:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543be2a00 x1869752809144704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135527.292061:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809144704:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783135527.292145:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135527.292288:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135527.293046:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3e680 x1869752809144320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135527.293067:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809144320:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1783135527.293082:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543794a80 x1869752809143680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135527.293108:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809143680:0@lo:400:kworker.0 00010000:00080000:3.0:1783135527.293124:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543794e00 x1869752809144192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135527.293133:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809144192:0@lo:400:kworker.0 00010000:00080000:0.0:1783135527.294070:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543be3480 x1869752809144576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135527.294111:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543be3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809144576:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1783135527.294126:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3c000 x1869752809144448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135527.294139:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809144448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783135527.791058:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135528.820111:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783135529.428436:0:13550:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:25:28 (1783135528) === 00000100:00100000:0.0:1783135529.652918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135529.652970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135529.653013:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785983872 00000100:00100000:0.0:1783135529.653026:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785983872 00000100:00100000:0.0:1783135529.653133:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:0.0:1783135529.653149:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785983872:12345-192.168.204.6@tcp:41:mkdir.0 00000004:00000024:0.0:1783135529.653210:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1783135529.653325:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752785983872:12345-192.168.204.6@tcp:41:mkdir.0 Request processed in 179us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135529.653334:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:0.0:1783135529.653366:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785984000 00000100:00100000:0.0:1783135529.653370:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785984000 00000100:00100000:0.0:1783135529.653396:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:0.0:1783135529.653404:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:10515:x1869752785984000:12345-192.168.204.6@tcp:700:mkdir.0 00000100:00100000:0.0:1783135529.654270:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:10515:x1869752785984000:12345-192.168.204.6@tcp:700:mkdir.0 Request processed in 863us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135529.654279:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00080000:0.0:1783135529.654309:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135529.658173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135529.658832:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785984256 00000100:00100000:3.0:1783135529.658847:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785984256 00000100:00100000:3.0:1783135529.658930:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:3.0:1783135529.658944:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:10515:x1869752785984256:12345-192.168.204.6@tcp:36:mkdir.0 00010000:00010000:3.0:1783135529.659051:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135529.662510:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edf9b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b0f expref: 6 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.662568:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac672e7a900) 00010000:00010000:3.0:1783135529.662593:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135529.662875:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb13 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.662889:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.662899:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.663059:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.663069:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.663076:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.664895:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.664914:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.665585:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135529.667530:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004496b0bf reply state 000000001e01c44b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.667560:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.667570:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135529.667574:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135529.667579:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783135529.667586:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783135529.667596:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb13 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.667604:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb13 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.667611:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb13 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.667617:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135529.667622:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb13 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.667641:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb13 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.667654:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac67c491e00) 00010000:00010000:3.0:1783135529.667657:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135529.667662:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb13 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.667688:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb13 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135529.667716:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004496b0bf reply state 000000001e01c44b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.667726:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.667732:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ac67c491200) 00010000:00010000:3.0:1783135529.667735:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135529.667737:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783135529.667895:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:10515:x1869752785984256:12345-192.168.204.6@tcp:36:mkdir.0 Request processed in 8949us (9734us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783135529.667906:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1783135529.686063:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135529.686343:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785984384 00000100:00100000:2.0:1783135529.686354:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785984384 00000100:00100000:2.0:1783135529.686419:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:2.0:1783135529.686431:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:10516:x1869752785984384:12345-192.168.204.6@tcp:101:chmod.0 00010000:00010000:2.0:1783135529.686455:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135529.686730:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628edfb28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ba2 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.686808:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.686822:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.686834:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135529.686883:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135529.686887:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135529.686922:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.686952:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628edfb28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ba2 expref: 9 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.686973:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ba2 expref: 8 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.686983:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac672e7a600) 00010000:00010000:2.0:1783135529.687441:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135529.687445:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e800, rc 0) 00000100:00100000:2.0:1783135529.687914:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:10516:x1869752785984384:12345-192.168.204.6@tcp:101:chmod.0 Request processed in 1482us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135529.687934:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:0.0:1783135529.704475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135529.711373:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785984640 00000100:00100000:1.0:1783135529.711401:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785984640 00000100:00100000:1.0:1783135529.711509:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:1.0:1783135529.711522:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:10516:x1869752785984640:12345-192.168.204.6@tcp:36:chmod.0 00010000:00010000:1.0:1783135529.711598:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135529.711654:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ba2 expref: 8 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135529.712216:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac672e7a600) 00010000:00010000:1.0:1783135529.712232:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135529.712273:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135529.712289:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135529.712303:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135529.712588:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000deefaefa reply state 0000000097aaed17 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135529.712604:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135529.712611:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6618fdd00) 00010000:00010000:1.0:1783135529.712614:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783135529.712618:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783135529.712640:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783135529.712782:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:10516:x1869752785984640:12345-192.168.204.6@tcp:36:chmod.0 Request processed in 1259us (8322us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783135529.712791:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:1.0:1783135529.780559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135529.780703:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785984768 00000100:00100000:0.0:1783135529.780716:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785984768 00000100:00100000:0.0:1783135529.780800:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:0.0:1783135529.780812:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:10517:x1869752785984768:12345-192.168.204.6@tcp:101:chown.0 00010000:00010000:0.0:1783135529.780848:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135529.780880:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ba9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.780976:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfb44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.780994:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfb44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.781012:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfb44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135529.781162:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135529.781166:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135529.781218:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfb44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.781280:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ba9 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.781307:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfb44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ba9 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.781318:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6618fdd00) 00010000:00010000:0.0:1783135529.781321:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135529.781326:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d400, rc 0) 00000100:00100000:0.0:1783135529.781423:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:10517:x1869752785984768:12345-192.168.204.6@tcp:101:chown.0 Request processed in 612us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135529.781432:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:0.0:1783135529.788062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135529.788619:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785984896 00000100:00100000:2.0:1783135529.788646:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785984896 00000100:00100000:2.0:1783135529.788734:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:2.0:1783135529.788746:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:10517:x1869752785984896:12345-192.168.204.6@tcp:101:chown.0 00010000:00010000:2.0:1783135529.788774:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135529.788799:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628edfb4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140bb0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.788884:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.788899:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.788912:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.788923:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfb59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.788931:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.788937:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789046:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfb60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789055:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfb60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789062:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfb60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135529.789159:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135529.789163:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135529.789187:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfb60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789200:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789208:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789214:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789220:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135529.789224:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789232:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789246:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6618fdd00) 00010000:00010000:2.0:1783135529.789254:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135529.789260:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789266:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfb52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789283:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789289:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfb59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789295:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfb59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789300:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135529.789303:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfb59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789309:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfb59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789317:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ac67c491200) 00010000:00010000:2.0:1783135529.789320:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135529.789322:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfb59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789326:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfb59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789354:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628edfb4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bb0 expref: 12 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789380:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfb60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bb0 expref: 11 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.789388:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:2.0:1783135529.789390:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135529.789392:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f600, rc 0) 00000100:00100000:2.0:1783135529.789487:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:10517:x1869752785984896:12345-192.168.204.6@tcp:101:chown.0 Request processed in 742us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135529.789495:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:1.0:1783135529.796310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135529.796407:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785985024 00000100:00100000:3.0:1783135529.796424:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785985024 00000100:00100000:3.0:1783135529.796575:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:3.0:1783135529.797808:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:10517:x1869752785985024:12345-192.168.204.6@tcp:900:chown.0 00000100:00100000:3.0:1783135529.797949:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:10517:x1869752785985024:12345-192.168.204.6@tcp:900:chown.0 Request processed in 1362us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135529.797959:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:1.0:1783135529.806801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135529.806941:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785985280 00000100:00100000:0.0:1783135529.806957:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785985280 00000100:00100000:0.0:1783135529.807055:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:0.0:1783135529.807069:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:10517:x1869752785985280:12345-192.168.204.6@tcp:36:chown.0 00010000:00010000:0.0:1783135529.807185:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135529.807223:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfb60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bb0 expref: 11 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.807248:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135529.807255:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135529.807287:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.807304:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.807337:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135529.833959:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1783135529.834163:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834190:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834199:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834206:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135529.834211:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834219:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834238:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ac67c491200) 00010000:00010000:2.0:1783135529.834241:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135529.834246:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834267:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb1a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834291:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834298:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834304:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834310:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135529.834313:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834319:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834328:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:2.0:1783135529.834330:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135529.834333:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834338:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb21 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834350:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834355:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834367:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834372:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51aa00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135529.834374:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834382:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834390:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6618fdd00) 00010000:00010000:2.0:1783135529.834392:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783135529.834395:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.834400:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628edfb36 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135529.838751:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1783135529.843386:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004effc93c reply state 000000006d4104f6 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.843413:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.843422:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135529.843425:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783135529.843429:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783135529.843443:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1783135529.843801:0:6523:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1783135529.843824:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:10517:x1869752785985280:12345-192.168.204.6@tcp:36:chown.0 Request processed in 36754us (37034us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783135529.843833:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 28 00010000:00010000:3.0:1783135529.843962:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.843972:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.843980:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.844001:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65cc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135529.844006:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.844014:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.844026:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135529.844029:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783135529.844032:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.844039:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135529.873420:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135529.873508:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785985408 00000100:00100000:3.0:1783135529.873532:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785985408 00000100:00100000:3.0:1783135529.873594:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:3.0:1783135529.873606:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:10518:x1869752785985408:12345-192.168.204.6@tcp:101:touch.500 00010000:00010000:3.0:1783135529.873640:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135529.873671:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140bb7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135529.874924:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1192us 00010000:00010000:0.0:1783135529.919300:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb75 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919324:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919337:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919353:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919381:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919388:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919537:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfb83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919546:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfb83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919553:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfb83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135529.919585:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135529.919589:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135529.919637:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfb83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919650:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919655:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb75 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919662:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919668:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65cc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135529.919672:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919685:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb75 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919698:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6618fdd00) 00010000:00010000:0.0:1783135529.919701:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135529.919706:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919712:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfb75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919726:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919731:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919737:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919741:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135529.919744:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919750:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919756:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ac5424cc800) 00010000:00010000:0.0:1783135529.919758:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135529.919761:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb7c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919777:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfb7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919816:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfb6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bb7 expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919848:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfb83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bb7 expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.919857:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac5424ccb00) 00010000:00010000:0.0:1783135529.919859:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783135529.919862:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d600, rc 0) 00000100:00100000:0.0:1783135529.919943:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:10518:x1869752785985408:12345-192.168.204.6@tcp:101:touch.500 Request processed in 46338us (46534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135529.919953:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:2.0:1783135529.925224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135529.925345:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785985664 00000100:00100000:3.0:1783135529.925363:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785985664 00000100:00100000:3.0:1783135529.925459:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:3.0:1783135529.925474:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:10518:x1869752785985664:12345-192.168.204.6@tcp:101:touch.500 00010000:00010000:3.0:1783135529.925502:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135529.925560:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfb8a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140bbe expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.925846:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfb91 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.925864:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfb91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.925877:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfb91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.925895:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.925902:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.925909:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135529.930593:0:8461:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1783135529.931428:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.931453:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.931467:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.931529:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfb91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.931556:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfb91 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.931564:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfb91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.931571:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135529.931579:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfb91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.931590:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfb91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.931610:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac5424ccb00) 00010000:00010000:3.0:1783135529.931614:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135529.931629:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfb91 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.931637:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfb91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135529.932198:0:8461:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002165de51 reply state 000000008d03401e transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.932218:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.932225:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbde1b7b (ffff8ac67c491700) 00010000:00010000:3.0:1783135529.932228:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135529.932233:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783135529.932294:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfb8a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bbe expref: 10 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.932338:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bbe expref: 9 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.932347:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ac67c491e00) 00010000:00010000:3.0:1783135529.932349:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135529.932351:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527400, rc 0) 00000100:00100000:3.0:1783135529.932475:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:10518:x1869752785985664:12345-192.168.204.6@tcp:101:touch.500 Request processed in 7004us (7258us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783135529.932488:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:3.0:1783135529.940962:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135529.941136:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785985920 00000100:00100000:0.0:1783135529.941152:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785985920 00000100:00100000:0.0:1783135529.941235:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:0.0:1783135529.941246:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:10518:x1869752785985920:12345-192.168.204.6@tcp:36:touch.500 00010000:00010000:0.0:1783135529.941311:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135529.941342:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfb9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bbe expref: 10 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.941370:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ac67c491e00) 00010000:00010000:0.0:1783135529.941382:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135529.941450:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.941484:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.941496:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135529.941633:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042d70564 reply state 00000000e2198ef7 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.941645:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135529.941651:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ac5424ccf00) 00010000:00010000:0.0:1783135529.941654:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135529.941656:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135529.941773:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:10518:x1869752785985920:12345-192.168.204.6@tcp:36:touch.500 Request processed in 527us (825us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1783135529.941780:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:1.0:1783135529.944716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135529.945079:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785986048 00000100:00100000:3.0:1783135529.945132:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785986048 00000100:00100000:3.0:1783135529.945225:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:3.0:1783135529.945241:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:10518:x1869752785986048:12345-192.168.204.6@tcp:101:touch.500 00010000:00010000:3.0:1783135529.945275:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135529.945302:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfbb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140bc5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.945389:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bc5 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.945408:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bc5 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135529.945432:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ac5424ccf00) 00010000:00010000:3.0:1783135529.945448:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135529.945452:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526e00, rc 0) 00000100:00100000:3.0:1783135529.945557:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:10518:x1869752785986048:12345-192.168.204.6@tcp:101:touch.500 Request processed in 320us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135529.945565:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:3.0:1783135529.951263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135529.951404:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785986176 00000100:00100000:0.0:1783135529.951420:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785986176 00000100:00100000:0.0:1783135529.951528:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:0.0:1783135529.951538:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1869752785986176:12345-192.168.204.6@tcp:8:touch.500 00010000:00080000:0.0:1783135529.951575:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:0.0:1783135529.951610:0:8435:0:(genops.c:1406:class_connect()) connect: client 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe, cookie 0xf7de4ef628edfbbb 00002000:00100000:0.0:1783135529.951634:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe/ffff8ac67f838800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135529.951652:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135529.951737:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783135529.951787:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8ac67f83b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135529.951880:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2397:x1869752785986176:12345-192.168.204.6@tcp:8:touch.500 Request processed in 341us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135529.951887:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:1.0:1783135529.960671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135529.963331:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785986304 00000100:00100000:2.0:1783135529.963348:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785986304 00000100:00100000:2.0:1783135529.963458:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:2.0:1783135529.963470:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:0:x1869752785986304:12345-192.168.204.6@tcp:2:touch.500 00000100:00080000:3.0:1783135529.964226:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1783135529.968709:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1783135529.968729:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000100:00100000:1.0:1783135529.969006:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:0:x1869752785986304:12345-192.168.204.6@tcp:2:touch.500 Request processed in 5529us (8334us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783135529.969022:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:1.0:1783135529.975022:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135529.976127:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785986560 00000100:00100000:0.0:1783135529.976145:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785986560 00000100:00100000:3.0:1783135529.976739:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:3.0:1783135529.976763:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:10518:x1869752785986560:12345-192.168.204.6@tcp:35:touch.500 00000100:00100000:3.0:1783135529.977223:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:10518:x1869752785986560:12345-192.168.204.6@tcp:35:touch.500 Request processed in 469us (2216us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783135529.977232:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:3.0:1783135530.007944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135530.010407:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785986688 00000100:00100000:2.0:1783135530.010430:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785986688 00000100:00100000:2.0:1783135530.010545:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:2.0:1783135530.010558:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:10519:x1869752785986688:12345-192.168.204.6@tcp:101:rm.0 00010000:00010000:2.0:1783135530.010593:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135530.010647:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfbc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140bcc expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135530.010750:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfbc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135530.010769:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135530.010784:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135530.010846:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135530.010850:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135530.010899:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfbc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135530.010930:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfbc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bcc expref: 15 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135530.010955:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfbc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bcc expref: 14 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135530.010965:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac5424ccb00) 00010000:00010000:2.0:1783135530.010969:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135530.010973:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e800, rc 0) 00000100:00100000:2.0:1783135530.011067:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:10519:x1869752785986688:12345-192.168.204.6@tcp:101:rm.0 Request processed in 510us (3137us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135530.011075:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:1.0:1783135530.031743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135530.031926:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785986944 00000100:00100000:2.0:1783135530.031963:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785986944 00000100:00100000:2.0:1783135530.032050:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:2.0:1783135530.032062:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:10519:x1869752785986944:12345-192.168.204.6@tcp:101:rm.0 00010000:00010000:2.0:1783135530.032126:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135530.032157:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfbd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140bd3 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135530.032424:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1783135530.032964:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfbd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bd3 expref: 16 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135530.032984:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6618fdd00) 00010000:00010000:2.0:1783135530.032988:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135530.032994:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfbd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bd3 expref: 16 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135530.033015:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e000, rc 0) 00000100:00100000:2.0:1783135530.033237:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:10519:x1869752785986944:12345-192.168.204.6@tcp:101:rm.0 Request processed in 1175us (1508us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1783135530.033246:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:0.0:1783135530.040314:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135530.040402:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785987072 00000100:00100000:3.0:1783135530.040415:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785987072 00000100:00100000:3.0:1783135530.040484:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:3.0:1783135530.040495:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:10519:x1869752785987072:12345-192.168.204.6@tcp:37:rm.0 00000100:00100000:3.0:1783135530.047564:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:10519:x1869752785987072:12345-192.168.204.6@tcp:37:rm.0 Request processed in 7050us (7246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135530.047584:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:1.0:1783135530.054071:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135530.054394:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785987328 00000100:00100000:2.0:1783135530.054410:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785987328 00000100:00100000:2.0:1783135530.054485:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:2.0:1783135530.054497:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6580b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:10519:x1869752785987328:12345-192.168.204.6@tcp:35:rm.0 00000100:00100000:2.0:1783135530.054994:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6580b2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:10519:x1869752785987328:12345-192.168.204.6@tcp:35:rm.0 Request processed in 496us (937us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783135530.055004:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:0.0:1783135530.067142:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135530.067485:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785987584 00000100:00100000:3.0:1783135530.067500:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785987584 00000100:00100000:3.0:1783135530.067595:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:3.0:1783135530.067607:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:10519:x1869752785987584:12345-192.168.204.6@tcp:101:rm.0 00010000:00010000:3.0:1783135530.067686:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135530.067713:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140bda expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.067862:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfbe5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.067883:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfbe5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.067898:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfbe5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135530.067913:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783135530.068077:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bda expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.068135:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfbe5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bda expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.068147:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac5424ccb00) 00010000:00010000:3.0:1783135530.068150:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135530.068154:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526400, rc 0) 00000100:00100000:3.0:1783135530.068921:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:10519:x1869752785987584:12345-192.168.204.6@tcp:101:rm.0 Request processed in 1311us (1842us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783135530.068933:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:0.0:1783135530.081016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135530.081241:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785987712 00000100:00100000:1.0:1783135530.081256:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785987712 00000100:00100000:1.0:1783135530.081333:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:1.0:1783135530.081345:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:10519:x1869752785987712:12345-192.168.204.6@tcp:41:rm.0 00000004:00000024:1.0:1783135530.081433:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1783135530.081536:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:10519:x1869752785987712:12345-192.168.204.6@tcp:41:rm.0 Request processed in 192us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135530.081545:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:1.0:1783135530.088348:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135530.088429:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785987840 00000100:00100000:2.0:1783135530.088442:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785987840 00000100:00100000:3.0:1783135530.088607:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:3.0:1783135530.088634:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:10519:x1869752785987840:12345-192.168.204.6@tcp:101:rm.0 00010000:00010000:3.0:1783135530.088847:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135530.088877:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628edfbf3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140be1 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.088973:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbfa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.088994:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbfa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089007:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbfa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089019:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfc01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089026:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfc01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089033:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfc01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089280:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfc08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089289:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfc08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089297:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfc08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135530.089340:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783135530.089351:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135530.089374:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfc08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089387:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfc08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089395:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbfa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089402:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbfa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089409:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbfa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089414:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135530.089419:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbfa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089428:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbfa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089441:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac5424ccb00) 00010000:00010000:3.0:1783135530.089444:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135530.089450:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbfa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089456:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527600/0xf7de4ef628edfbfa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089470:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfc01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089485:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfc01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089491:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfc01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089496:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135530.089498:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfc01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089951:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfc01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089963:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbde1b7b (ffff8ac67c491700) 00010000:00010000:3.0:1783135530.089965:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135530.089968:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfc01 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.089973:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527400/0xf7de4ef628edfc01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.090009:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628edfbf3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140be1 expref: 20 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.090022:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfc08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140be1 expref: 19 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135530.090029:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ac5424ccf00) 00010000:00010000:3.0:1783135530.090031:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135530.090042:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527e00, rc 0) 00000100:00100000:3.0:1783135530.090762:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:10519:x1869752785987840:12345-192.168.204.6@tcp:101:rm.0 Request processed in 2134us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135530.090775:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:3.0:1783135530.108371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135530.108534:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785988096 00000100:00100000:0.0:1783135530.108551:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785988096 00000100:00100000:0.0:1783135530.108646:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:0.0:1783135530.108677:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:10519:x1869752785988096:12345-192.168.204.6@tcp:36:rm.0 00010000:00010000:0.0:1783135530.108770:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783135530.108807:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfc08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140be1 expref: 19 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.108837:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfbb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bc5 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.108850:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ac5424ccf00) 00010000:00010000:0.0:1783135530.108862:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfbc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bcc expref: 17 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.108871:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac5424ccb00) 00010000:00010000:0.0:1783135530.108875:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135530.108907:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfc0f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.108948:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfc0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.108961:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfc0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.108975:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.108982:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.108988:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.109212:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfc1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.109221:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfc1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.109229:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfc1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135530.113146:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783135530.113175:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 433906086486ns, next at 434906082196ns, rc = 0 00010000:00010000:0.0:1783135530.118165:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118199:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118341:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118351:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118357:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118362:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118379:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135530.118410:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfc1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118416:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfc1d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118421:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfc1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118428:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135530.118432:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfc1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118440:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfc1d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118454:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ac5424ccf00) 00010000:00010000:0.0:1783135530.118457:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783135530.118469:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfc1d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.118475:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfc1d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135530.118577:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135530.118584:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135530.118591:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989600 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135530.118594:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135530.118611:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135530.118628:0:8453:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ac5424ccf00) 00010000:00010000:1.0:1783135530.118631:0:8453:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783135530.118642:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135530.118649:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfc24 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135530.118668:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135530.118670:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135530.118671:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135530.119369:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfc0f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.119378:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfc0f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.119384:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfc0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.119389:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135530.119392:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfc0f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.119398:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfc0f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.119408:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac5424ccb00) 00010000:00010000:0.0:1783135530.119410:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135530.119413:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfc0f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.119418:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfc0f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135530.119428:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004303327 reply state 0000000023a3483d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.119454:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.119461:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbde1b7b (ffff8ac67c491700) 00010000:00010000:0.0:1783135530.119463:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135530.119466:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135530.119570:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:10519:x1869752785988096:12345-192.168.204.6@tcp:36:rm.0 Request processed in 10898us (11213us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783135530.119580:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:1.0:1783135530.132224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135530.132440:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785988352 00000100:00100000:2.0:1783135530.132450:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785988352 00000100:00100000:2.0:1783135530.132525:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:2.0:1783135530.132536:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:10519:x1869752785988352:12345-192.168.204.6@tcp:35:rm.0 00000100:00100000:2.0:1783135530.132819:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:10519:x1869752785988352:12345-192.168.204.6@tcp:35:rm.0 Request processed in 284us (618us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783135530.132827:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:1.0:1783135530.137296:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135530.137486:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785988608 00000100:00100000:0.0:1783135530.137510:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785988608 00000100:00100000:0.0:1783135530.137601:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:0.0:1783135530.137623:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:10519:x1869752785988608:12345-192.168.204.6@tcp:36:rm.0 00010000:00010000:0.0:1783135530.137727:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783135530.137765:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfbe5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bda expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138059:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfb83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bb7 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138074:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac5424ccb00) 00010000:00010000:0.0:1783135530.138164:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfb44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ba9 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138175:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6618fdd00) 00010000:00010000:0.0:1783135530.138183:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135530.138304:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988200/0xf7de4ef628edfc2b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138320:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988200/0xf7de4ef628edfc2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138331:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988200/0xf7de4ef628edfc2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138345:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138352:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138358:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138466:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc39 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138475:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc39 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.138481:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc39 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135530.143497:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783135530.143611:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc39 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.143634:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc39 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.143948:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc39 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.143955:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135530.143961:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc39 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.143971:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc39 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.143994:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ac5424ccd00) 00010000:00010000:0.0:1783135530.143997:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783135530.144002:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc39 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.144009:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc39 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.144045:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988200/0xf7de4ef628edfc2b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.144052:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988200/0xf7de4ef628edfc2b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.144058:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988200/0xf7de4ef628edfc2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.144063:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135530.144066:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988200/0xf7de4ef628edfc2b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.144083:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988200/0xf7de4ef628edfc2b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.144137:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cc800) 00010000:00010000:0.0:1783135530.144139:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135530.144143:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988200/0xf7de4ef628edfc2b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.144149:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988200/0xf7de4ef628edfc2b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135530.144163:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026e35c6a reply state 00000000603529f3 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.144178:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135530.144369:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ac5424cca00) 00010000:00010000:0.0:1783135530.144373:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135530.144377:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135530.144554:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:10519:x1869752785988608:12345-192.168.204.6@tcp:36:rm.0 Request processed in 6937us (7268us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1783135530.144565:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:1.0:1783135530.352707:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135530.352741:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809144960:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135530.352841:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135530.353129:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809144960 00000100:00100000:0.0:1783135530.353141:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809144960 00000100:00100000:0.0:1783135530.353207:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783135530.353220:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809144960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135530.353267:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135530.353335:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809144960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135530.353364:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783135530.353858:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809144960:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135530.863940:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135531.580721:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135531.580769:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135531.580791:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135531.580821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135531.580841:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135531.580870:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135531.580905:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785988864 00000100:00100000:1.0:1783135531.580917:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785988864 00000100:00100000:1.0:1783135531.580988:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785989376 00000100:00100000:1.0:1783135531.580991:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785989376 00000100:00100000:1.0:1783135531.581005:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785988992 00000100:00100000:1.0:1783135531.581008:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785988992 00000100:00100000:1.0:1783135531.581019:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785989248 00000100:00100000:1.0:1783135531.581021:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785989248 00000100:00100000:1.0:1783135531.581036:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 250 00000100:00100000:1.0:1783135531.581046:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:2399:x1869752785988864:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135531.581190:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:2399:x1869752785988864:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 145us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135531.581199:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 250 00000100:00100000:1.0:1783135531.581220:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 251 00000100:00100000:1.0:1783135531.581227:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785989376:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135531.581254:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785989376:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135531.581261:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 251 00000100:00100000:1.0:1783135531.581272:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 252 00000100:00100000:1.0:1783135531.581278:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785988992:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135531.581299:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785988992:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 21us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135531.581306:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 252 00000100:00100000:1.0:1783135531.581316:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 253 00000100:00100000:1.0:1783135531.581322:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785989248:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135531.581341:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785989248:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 19us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135531.581347:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 253 00000100:00100000:1.0:1783135531.581366:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785989120 00000100:00100000:1.0:1783135531.581370:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785989120 00000100:00100000:1.0:1783135531.581399:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:1.0:1783135531.581405:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785989120:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135531.581429:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785989120:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135531.581442:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:1.0:1783135531.581465:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785988736 00000100:00100000:1.0:1783135531.581469:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785988736 00000100:00100000:1.0:1783135531.581515:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 345 00000100:00100000:1.0:1783135531.581522:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785988736:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135531.581549:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785988736:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135531.581555:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 345 00000100:00080000:1.0:1783135531.581600:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135531.581607:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135531.581609:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783135531.893336:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135532.399447:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809145088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135532.399537:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.399653:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809145216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135532.399680:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.399716:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809145088 00000100:00100000:3.0:1783135532.399726:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809145088 00000100:00100000:3.0:1783135532.399785:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809145216 00000100:00100000:3.0:1783135532.399788:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809145216 00000100:00100000:3.0:1783135532.399806:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783135532.399816:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809145088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135532.399858:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135532.399910:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809145088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.399917:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783135532.399938:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783135532.399944:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809145216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135532.399961:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135532.399991:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809145216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.399998:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1783135532.400026:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135532.400031:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783135532.400079:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3e300 x1869752809145216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135532.400124:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809145216:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1783135532.400155:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3c700 x1869752809145088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135532.400167:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809145088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135532.400325:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809145344:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.400363:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.400391:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809145856:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.400417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.400436:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809146368:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.400462:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.400482:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783135532.400488:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809145728:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.400508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.400525:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809146240:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.400551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.400595:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809145344 00000100:00100000:3.0:1783135532.400599:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809145344 00000100:00100000:3.0:1783135532.400632:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1783135532.400639:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809145344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.400677:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809145344:12345-0@lo:400:kworker.0 Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.400693:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1783135532.400731:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809145856 00000100:00100000:3.0:1783135532.400736:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809145856 00000100:00100000:3.0:1783135532.400764:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783135532.400771:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809145856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.400806:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809145856:12345-0@lo:400:kworker.0 Request processed in 35us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.400812:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783135532.400831:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809146368 00000100:00100000:3.0:1783135532.400835:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809146368 00000100:00100000:3.0:1783135532.400867:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809145728 00000100:00100000:3.0:1783135532.400871:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809145728 00000100:00100000:3.0:1783135532.400890:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783135532.400896:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809146368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.400926:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809146368:12345-0@lo:400:kworker.0 Request processed in 30us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.400931:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783135532.400942:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1783135532.400947:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809145728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.400968:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809145728:12345-0@lo:400:kworker.0 Request processed in 21us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.400973:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1783135532.400994:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809146240 00000100:00100000:3.0:1783135532.400998:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809146240 00000100:00100000:3.0:1783135532.401025:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783135532.401032:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809146240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401068:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809146240:12345-0@lo:400:kworker.0 Request processed in 37us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.401075:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783135532.401139:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809145472:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401167:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.401188:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809145984:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.401220:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809146496:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.401252:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783135532.401257:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809145600:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401278:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.401295:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809146112:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.401331:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809146624:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401352:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.401379:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809145472 00000100:00100000:3.0:1783135532.401383:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809145472 00000100:00100000:3.0:1783135532.401404:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809145984 00000100:00100000:3.0:1783135532.401406:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809145984 00000100:00100000:3.0:1783135532.401420:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809146496 00000100:00100000:3.0:1783135532.401422:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809146496 00000100:00100000:3.0:1783135532.401435:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809146112 00000100:00100000:3.0:1783135532.401437:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809146112 00000100:00100000:3.0:1783135532.401452:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783135532.401458:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809145472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401504:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809145472:12345-0@lo:400:kworker.0 Request processed in 45us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.401511:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1783135532.401523:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783135532.401529:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809145984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401562:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809145984:12345-0@lo:400:kworker.0 Request processed in 33us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.401568:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783135532.401593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783135532.401598:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809146496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401624:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809146496:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.401630:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783135532.401641:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783135532.401646:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809146112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401668:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809146112:12345-0@lo:400:kworker.0 Request processed in 23us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.401674:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783135532.401689:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809145600 00000100:00100000:3.0:1783135532.401693:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809145600 00000100:00100000:3.0:1783135532.401714:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783135532.401721:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809145600:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1783135532.401725:0:8613:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 436194635797ns, next at 437194632411ns, rc = 0 00000100:00100000:3.0:1783135532.401750:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809145600:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.401757:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783135532.401779:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809146624 00000100:00100000:3.0:1783135532.401783:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809146624 00000100:00100000:3.0:1783135532.401824:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783135532.401831:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809146624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.401862:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809146624:12345-0@lo:400:kworker.0 Request processed in 31us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.401868:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1783135532.401891:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135532.401896:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135532.401898:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135532.401901:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135532.401915:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809146752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135532.401948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.401984:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135532.401989:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809146880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135532.402029:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.402070:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809147008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135532.402114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135532.402145:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809145600:0@lo:400:kworker.0 00010000:00080000:3.0:1783135532.402157:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc5500 x1869752809146112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135532.402167:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809146112:0@lo:400:kworker.0 00010000:00080000:3.0:1783135532.402175:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a76a00 x1869752809146624/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135532.402182:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809146624:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.402203:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809145472:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.402213:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809145984:0@lo:400:kworker.0 00010000:00080000:3.0:1783135532.402223:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc7100 x1869752809146496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135532.402231:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809146496:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.402270:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809147008 00000100:00100000:3.0:1783135532.402273:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809147008 00000100:00100000:3.0:1783135532.402295:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783135532.402301:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809147008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135532.402329:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135532.402370:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809147008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135532.402376:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783135532.402408:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809145728:0@lo:400:kworker.0 00010000:00080000:3.0:1783135532.402421:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc4700 x1869752809146240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135532.402429:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809146240:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.402438:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809145344:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.402452:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809145856:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.402463:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809146368:0@lo:400:kworker.0 00000100:00100000:3.0:1783135532.402507:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809147008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135532.402646:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809146752 00000100:00100000:2.0:1783135532.402650:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809146752 00000100:00100000:2.0:1783135532.402684:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809146880 00000100:00100000:2.0:1783135532.402687:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809146880 00000100:00100000:2.0:1783135532.402700:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783135532.402706:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809146752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135532.402722:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135532.402768:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809146752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135532.402773:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783135532.402785:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783135532.402790:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809146880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135532.402800:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135532.402824:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809146880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135532.402829:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:2.0:1783135532.402852:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543ad9c00 x1869752809146880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135532.402874:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809146880:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1783135532.402886:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543ad8a80 x1869752809146752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135532.402895:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809146752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783135532.912819:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135533.937446:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135534.579682:0:13697:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1783135534.959320:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135535.471557:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809147136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135535.471680:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135535.471787:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809147136 00000100:00100000:0.0:1783135535.471799:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809147136 00000100:00100000:0.0:1783135535.471862:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783135535.471873:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809147136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135535.471923:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135535.473798:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809147136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135535.473830:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783135535.473954:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809147136:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1783135535.829880:0:13747:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe45d62e10 20000000:00000080:0.0:1783135535.829899:0:13747:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac67c7a5800 uarg=0000000000000000 20000000:01000000:0.0:1783135535.830018:0:13747:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783135535.830025:0:13747:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1783135535.830031:0:13747:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1783135535.834565:0:13748:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1783135535.836654:0:13747:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1783135535.860977:0:13747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1783135535.861048:0:13747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1783135535.861063:0:13747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1783135535.861081:0:13747:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783135535.861153:0:13747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.861177:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c51ba00/0xf7de4ef628edfad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfacd expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.861185:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c51b400/0xf7de4ef628edfae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfadb expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.861191:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edfaf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfae9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.861197:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfafe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfaf7 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.861207:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfb05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b94 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.861214:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edfb0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b9b expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.861221:0:13747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.861292:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edfb0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b9b expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.861310:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edfb0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b9b expref: 12 pid: 6517 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135535.861328:0:13747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147264:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135535.863050:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfb05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b94 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.863070:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfb05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b94 expref: 12 pid: 6516 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135535.863121:0:13747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147392:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135535.863225:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfafe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edfaf7 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.863233:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfafe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edfaf7 expref: 23 pid: 6517 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135535.863243:0:13747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147520:0@lo:104: 00000100:00100000:2.0:1783135535.863295:0:13747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135535.863338:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edfaf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edfae9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.863348:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edfaf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edfae9 expref: 23 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135535.863356:0:13747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147648:0@lo:104: 00010000:00010000:2.0:1783135535.863400:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c51b400/0xf7de4ef628edfae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edfadb expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.863409:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c51b400/0xf7de4ef628edfae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edfadb expref: 23 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135535.863418:0:13747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147776:0@lo:104: 00010000:00010000:2.0:1783135535.863668:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c51ba00/0xf7de4ef628edfad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628edfacd expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.863677:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ac67c51ba00/0xf7de4ef628edfad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628edfacd expref: 23 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135535.863753:0:13747:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147904:0@lo:104: 00000100:00100000:2.0:1783135535.863781:0:13747:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672de49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135535.863900:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783135535.863923:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135535.863951:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135535.863960:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135535.863970:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809147520 00000100:00100000:3.0:1783135535.863978:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809147520 00000100:00100000:3.0:1783135535.864027:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809147648 00000100:00100000:3.0:1783135535.864030:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809147648 00000100:00100000:3.0:1783135535.864042:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809147776 00000100:00100000:3.0:1783135535.864045:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809147776 00000100:00100000:3.0:1783135535.864054:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809147904 00000100:00100000:3.0:1783135535.864056:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809147904 00000100:00100000:3.0:1783135535.864071:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783135535.864080:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:13747:x1869752809147520:12345-0@lo:104: 00010000:00010000:3.0:1783135535.864134:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.864196:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783135535.864204:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+6:13747:x1869752809147520:12345-0@lo:104: Request processed in 124us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135535.864210:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783135535.864254:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783135535.864271:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:13747:x1869752809147648:12345-0@lo:104: 00010000:00010000:3.0:1783135535.864278:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.864314:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783135535.864319:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+5:13747:x1869752809147648:12345-0@lo:104: Request processed in 50us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135535.864325:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783135535.864338:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783135535.864343:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:13747:x1869752809147776:12345-0@lo:104: 00010000:00010000:3.0:1783135535.864350:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.864384:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783135535.864392:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+4:13747:x1869752809147776:12345-0@lo:104: Request processed in 47us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135535.864399:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783135535.864411:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783135535.864416:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:13747:x1869752809147904:12345-0@lo:104: 00010000:00010000:3.0:1783135535.864423:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.864892:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1783135535.864901:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+3:13747:x1869752809147904:12345-0@lo:104: Request processed in 483us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135535.864907:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1783135535.864930:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783135535.864944:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.864953:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527000 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135535.864957:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.864968:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135535.864976:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135535.864983:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783135535.865028:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865036:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135535.865060:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865067:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628edfaf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865083:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783135535.865103:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865110:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135535.865112:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865129:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135535.865135:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135535.865140:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783135535.865156:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865162:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135535.865168:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865174:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c600/0xf7de4ef628edfae9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865184:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135535.865187:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865192:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b200 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135535.865195:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865202:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135535.865208:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135535.865218:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783135535.865232:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865237:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135535.865255:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865262:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b200/0xf7de4ef628edfadb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfae2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865272:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135535.865275:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865280:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c200 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135535.865283:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865289:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135535.865294:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135535.865300:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783135535.865313:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865319:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135535.865335:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865342:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c200/0xf7de4ef628edfacd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628edfad4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.865358:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135535.865360:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135535.865362:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135535.865370:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135535.865377:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135535.865403:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809148032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135535.865571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135535.865620:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135535.865627:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809148160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135535.865650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135535.865846:0:13747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147520:0@lo:104: 00000100:00100000:2.0:1783135535.865859:0:13747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147648:0@lo:104: 00000100:00100000:2.0:1783135535.865868:0:13747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abe300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147776:0@lo:104: 00000100:00100000:2.0:1783135535.865877:0:13747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147904:0@lo:104: 00000100:00100000:2.0:1783135535.865917:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809148160 00000100:00100000:2.0:1783135535.865923:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809148160 00010000:00010000:2.0:1783135535.865957:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edfaf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfae9 expref: 24 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135535.865988:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135535.865997:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809148160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135535.866012:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135535.866017:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edfaf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfae9 expref: 24 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.866035:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edfaf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edfae9 expref: 24 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.866051:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51a800/0xf7de4ef628edfaf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edfae9 expref: 24 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.866065:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135535.866124:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:3646:x1869752809148160:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135535.866132:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135535.866170:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809148160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135535.866260:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809148032 00000100:00100000:3.0:1783135535.866265:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809148032 00010000:00010000:3.0:1783135535.867571:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783135535.872849:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1783135535.872912:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:0.0:1783135535.874239:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809148288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135535.874337:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135535.874857:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135535.874868:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809148416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135535.874906:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135535.875040:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809148288 00000100:00100000:0.0:1783135535.875051:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809148288 00000004:00080000:1.0:1783135535.875059:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1783135535.875129:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.875142:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c51b400/0xf7de4ef628edfae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfadb expref: 24 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875145:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875165:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875172:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135535.875178:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135535.875186:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809148416 00010000:00010000:1.0:1783135535.875188:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135535.875191:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809148416 00010000:00010000:0.0:1783135535.875206:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c51ba00/0xf7de4ef628edfad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfacd expref: 25 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875221:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbde1b7b (ffff8ac67c491700) 00010000:00010000:1.0:1783135535.875227:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135535.875232:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1783135535.875233:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875243:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfb98 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135535.875244:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+25:3648:x1869752809148288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135535.875266:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135535.875273:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.875275:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c51b400/0xf7de4ef628edfae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfadb expref: 25 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875289:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.875297:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c51b400/0xf7de4ef628edfae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edfadb expref: 25 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875299:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875318:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65ca00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135535.875321:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875328:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.875329:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51b400/0xf7de4ef628edfae2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edfadb expref: 25 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875348:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ac5424ccf00) 00010000:00010000:1.0:1783135535.875352:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135535.875355:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135535.875357:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875365:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfbad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875417:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875425:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875432:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875437:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65cc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135535.875441:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875448:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875458:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbde1b7b (ffff8ac67c491700) 00010000:00010000:1.0:1783135535.875461:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135535.875465:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875472:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfc16 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbde1b7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135535.875484:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809148288:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (1146us total) trans 0 rc 0/0 00010000:00010000:1.0:1783135535.875489:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135535.875496:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1783135535.875501:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875517:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875528:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135535.875542:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875548:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875556:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ac5424cca00) 00010000:00010000:1.0:1783135535.875559:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135535.875562:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.875567:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfc32 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135535.875703:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783135535.875710:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:3648:x1869752809148416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135535.875718:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135535.875722:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c51ba00/0xf7de4ef628edfad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfacd expref: 23 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.875745:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c51ba00/0xf7de4ef628edfad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edfacd expref: 23 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.875756:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51ba00/0xf7de4ef628edfad4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edfacd expref: 23 pid: 6515 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.875764:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135535.875789:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:3648:x1869752809148416:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135535.875795:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783135535.875843:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809148416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135535.875854:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809148288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135535.875881:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135535.875892:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809148544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783135535.875932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135535.875952:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfafe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfaf7 expref: 21 pid: 6517 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135535.875983:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135535.875993:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3646:x1869752809148032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135535.876002:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135535.876007:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfafe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628edfaf7 expref: 21 pid: 6517 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.876015:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfafe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628edfaf7 expref: 21 pid: 6517 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.876027:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628edfafe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628edfaf7 expref: 21 pid: 6517 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.876038:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135535.876671:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809148544 00000100:00100000:1.0:1783135535.876679:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809148544 00000100:00100000:1.0:1783135535.876781:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135535.876791:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809148544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783135535.876826:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1783135535.876874:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a487d2a, atime: 0x6a487d2a, ctime: 0x6a487d2a, blocks: 0x0 00010000:00010000:1.0:1783135535.876882:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027f4d3ad/0xf7de4ef628edfc47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.876900:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1783135535.876906:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135535.877000:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027f4d3ad/0xf7de4ef628edfc47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.877039:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027f4d3ad/0xf7de4ef628edfc47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.877051:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027f4d3ad/0xf7de4ef628edfc47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.877059:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027f4d3ad/0xf7de4ef628edfc47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.877082:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1783135535.879163:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135535.883679:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:3646:x1869752809148032:12345-0@lo:103:ldlm_bl.0 Request processed in 7672us (18092us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135535.883740:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783135535.883960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135535.884033:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785989504 00000100:00100000:2.0:1783135535.884043:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785989504 00000100:00100000:0.0:1783135535.884044:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809148032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135535.884120:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edfb0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b9b expref: 13 pid: 6517 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135535.884159:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:2.0:1783135535.884172:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2401:x1869752785989504:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135535.884190:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135535.884198:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edfb0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b9b expref: 13 pid: 6517 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.884213:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edfb0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b9b expref: 13 pid: 6517 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.884243:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135535.884279:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135535.884290:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027f4d3ad/0xf7de4ef628edfc47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.884304:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51bc00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135535.884310:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027f4d3ad/0xf7de4ef628edfc47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135535.884313:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2401:x1869752785989504:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 143us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135535.884330:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 50 00010000:00010000:0.0:1783135535.884349:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027f4d3ad/0xf7de4ef628edfc47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.884372:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027f4d3ad/0xf7de4ef628edfc47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.884394:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027f4d3ad/0xf7de4ef628edfc47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135535.884426:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135535.884428:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135535.884430:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135535.885847:0:13747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c526600/0xf7de4ef628edfb0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b9b expref: 12 pid: 6517 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135535.885868:0:13747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147264:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135535.887500:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1869752809148544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10697us (11554us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783135535.887526:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1783135535.890193:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac543794a80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1783135535.890217:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809148544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783135535.891949:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135535.892031:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785989632 00000100:00100000:1.0:1783135535.892042:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785989632 00010000:00010000:1.0:1783135535.892131:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfb05 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b94 expref: 12 pid: 6516 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135535.892177:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:1.0:1783135535.892189:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:2400:x1869752785989632:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135535.892208:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135535.892214:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfb05 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b94 expref: 12 pid: 6516 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892230:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfb05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b94 expref: 12 pid: 6516 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892280:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892291:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892310:0:10344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892318:0:10344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892325:0:10344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892332:0:10344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892339:0:10344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527400 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135535.892344:0:10344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892353:0:10344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892362:0:10344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135535.892374:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135535.892456:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:2400:x1869752785989632:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 267us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135535.892795:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00010000:00010000:2.0:1783135535.892892:0:13747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfb05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b94 expref: 11 pid: 6516 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135535.892911:0:13747:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1869752809147392:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135535.892953:0:13747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.892963:0:13747:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.892982:0:13747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135535.892988:0:13747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527400/0xf7de4ef628edfc40 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135535.982895:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135536.694916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135536.694970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135536.695130:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785989888 00000100:00100000:3.0:1783135536.695145:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785989888 00000100:00100000:0.0:1783135536.695323:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 260 00000100:00100000:0.0:1783135536.695338:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785989888:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135536.695449:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785989888:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 114us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135536.695459:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 260 00000100:00100000:2.0:1783135536.696038:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135536.696080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135536.696125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135536.696157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135536.696182:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785990400 00000100:00100000:2.0:1783135536.696187:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785990400 00000100:00100000:2.0:1783135536.696218:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785990016 00000100:00100000:2.0:1783135536.696221:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785990016 00000100:00100000:2.0:1783135536.696237:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785990272 00000100:00100000:2.0:1783135536.696239:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785990272 00000100:00100000:2.0:1783135536.696255:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 261 00000100:00100000:2.0:1783135536.696262:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785990400:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135536.696310:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785990400:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 48us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135536.696318:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 261 00000100:00100000:2.0:1783135536.696333:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 262 00000100:00100000:2.0:1783135536.696340:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785990016:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135536.696366:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785990016:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135536.696387:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 262 00000100:00100000:2.0:1783135536.696400:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 263 00000100:00100000:2.0:1783135536.696406:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785990272:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135536.696433:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785990272:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135536.696440:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 263 00000100:00100000:0.0:1783135536.696813:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785989760 00000100:00100000:0.0:1783135536.696818:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785989760 00000100:00100000:0.0:1783135536.696862:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 347 00000100:00100000:0.0:1783135536.696870:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:2399:x1869752785989760:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135536.696938:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:2399:x1869752785989760:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 68us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135536.696955:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 347 00000100:00080000:3.0:1783135536.697179:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135536.697186:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135536.698973:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785990144 00000100:00100000:1.0:1783135536.698989:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785990144 00000100:00100000:0.0:1783135536.699250:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:0.0:1783135536.699264:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785990144:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135536.699375:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785990144:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 114us (4403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135536.699383:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00080000:3.0:1783135536.699447:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783135537.006628:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783135537.036249:0:13796:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe57219810 20000000:00000080:3.0:1783135537.036274:0:13796:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac544040c00 uarg=0000000000000000 20000000:01000000:3.0:1783135537.036337:0:13796:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1783135537.036345:0:13796:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1783135537.036352:0:13796:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1783135537.039275:0:13797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1783135537.039506:0:13796:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1783135537.039656:0:13796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1783135537.039690:0:13796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1783135537.039706:0:13796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1783135537.039720:0:13796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783135537.039750:0:13796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.039771:0:13796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.039784:0:13796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.039791:0:13796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.039799:0:13796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.039807:0:13796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.039813:0:13796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51ae00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135537.039818:0:13796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.039826:0:13796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.039851:0:13796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.039859:0:13796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.039866:0:13796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc4e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135537.518567:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809148672:0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.518652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.518810:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809148672 00000100:00100000:1.0:1783135537.518818:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809148672 00000100:00100000:1.0:1783135537.518868:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1783135537.518877:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:3647:x1869752809148672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.518942:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:3647:x1869752809148672:12345-0@lo:400:kworker.0 Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135537.518950:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1783135537.518999:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809148672:0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.520158:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809149056:0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.520201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.520231:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809149568:0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.520259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.520289:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809150080:0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.520307:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.520333:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809150592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135537.520357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.520376:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1783135537.520382:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809149184:0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.520402:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.520420:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809149696:0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.520444:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.520459:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809150208:0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.520490:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.520506:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809150720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135537.520538:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.520574:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809149568 00000100:00100000:1.0:1783135537.520580:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809149568 00000100:00100000:1.0:1783135537.520623:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809150080 00000100:00100000:1.0:1783135537.520627:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809150080 00000100:00100000:1.0:1783135537.520646:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809149184 00000100:00100000:1.0:1783135537.520649:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809149184 00000100:00100000:1.0:1783135537.520664:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783135537.520671:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809149568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.520728:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809149568:12345-0@lo:400:kworker.0 Request processed in 57us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135537.520949:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809148928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135537.520978:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135537.520997:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809149312:0@lo:400:kworker.0 00000100:00100000:0.0:1783135537.521131:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135537.521150:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809149824:0@lo:400:kworker.0 00000100:00100000:0.0:1783135537.521173:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135537.521188:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809150336:0@lo:400:kworker.0 00000100:00100000:0.0:1783135537.521209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135537.521222:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809150848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135537.521239:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135537.521253:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1783135537.521259:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809148800:0@lo:400:kworker.0 00000100:00100000:0.0:1783135537.521294:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135537.521306:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809149440:0@lo:400:kworker.0 00000100:00100000:0.0:1783135537.521328:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135537.521338:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809149952:0@lo:400:kworker.0 00000100:00100000:0.0:1783135537.521358:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135537.521380:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809150464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135537.521413:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135537.521448:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809149696 00000100:00100000:0.0:1783135537.521453:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809149696 00000100:00100000:0.0:1783135537.521545:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809150208 00000100:00100000:0.0:1783135537.521549:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809150208 00000100:00100000:0.0:1783135537.521563:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809149824 00000100:00100000:0.0:1783135537.521565:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809149824 00000100:00100000:0.0:1783135537.521579:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809150336 00000100:00100000:0.0:1783135537.521581:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809150336 00000100:00100000:0.0:1783135537.521596:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135537.521603:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809149696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135537.521641:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809149696:12345-0@lo:400:kworker.0 Request processed in 38us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135537.521648:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135537.521663:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783135537.521669:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809150208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135537.521696:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809150208:12345-0@lo:400:kworker.0 Request processed in 27us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135537.521713:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783135537.521725:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783135537.521837:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809148800 00000100:00100000:2.0:1783135537.521842:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809148800 00000100:00100000:2.0:1783135537.521863:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809149440 00000100:00100000:2.0:1783135537.521865:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809149440 00000100:00100000:2.0:1783135537.521878:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809149952 00000100:00100000:2.0:1783135537.521880:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809149952 00000100:00100000:2.0:1783135537.521896:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783135537.521903:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809150080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135537.521938:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809150080:12345-0@lo:400:kworker.0 Request processed in 36us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.521944:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783135537.521958:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783135537.521964:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809149184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135537.521993:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809149184:12345-0@lo:400:kworker.0 Request processed in 29us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.521999:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1783135537.522010:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1783135537.522015:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809148800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135537.522156:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809148800:12345-0@lo:400:kworker.0 Request processed in 140us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.522169:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1783135537.522182:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1783135537.522188:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809149440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135537.522213:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809149440:12345-0@lo:400:kworker.0 Request processed in 26us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.522219:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1783135537.522227:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1783135537.522232:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809149952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135537.522251:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809149952:12345-0@lo:400:kworker.0 Request processed in 19us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.522256:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1783135537.522274:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809150592 00000100:00100000:2.0:1783135537.522277:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809150592 00000100:00100000:2.0:1783135537.522291:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809150720 00000100:00100000:2.0:1783135537.522293:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809150720 00000100:00100000:2.0:1783135537.522300:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809148928 00000100:00100000:2.0:1783135537.522302:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809148928 00000100:00100000:2.0:1783135537.522308:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809150848 00000100:00100000:2.0:1783135537.522310:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809150848 00000100:00100000:2.0:1783135537.522319:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783135537.522324:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809150592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135537.522344:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135537.522369:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809150592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.522374:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783135537.522383:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783135537.522388:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1869752809150720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135537.522415:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135537.522438:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1869752809150720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.522443:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783135537.522452:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783135537.522456:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809148928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135537.522463:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135537.522494:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809148928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.522500:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783135537.522509:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783135537.522515:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809150848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135537.522523:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135537.522541:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809150848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 27us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.522546:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783135537.522562:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783135537.523137:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809149056 00000100:00100000:3.0:1783135537.523144:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809149056 00000100:00100000:3.0:1783135537.523170:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809149312 00000100:00100000:3.0:1783135537.523172:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809149312 00000100:00100000:3.0:1783135537.523181:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809150464 00000100:00100000:3.0:1783135537.523183:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809150464 00000100:00100000:3.0:1783135537.523194:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783135537.523200:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809149056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135537.523243:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809149056:12345-0@lo:400:kworker.0 Request processed in 43us (3042us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.523249:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783135537.523260:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783135537.523265:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809149312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135537.523299:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809149312:12345-0@lo:400:kworker.0 Request processed in 34us (2168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.523305:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783135537.523314:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783135537.523319:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809150464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135537.523337:0:13344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135537.523370:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809150464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.523376:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1783135537.523393:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135537.523397:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135537.523399:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135537.523401:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135537.523454:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809148800:0@lo:400:kworker.0 00000100:00100000:3.0:1783135537.523466:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809149440:0@lo:400:kworker.0 00000100:00100000:3.0:1783135537.523489:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809149952:0@lo:400:kworker.0 00000100:00100000:3.0:1783135537.523505:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809150464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135537.523519:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c6cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809148928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135537.523528:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809149312:0@lo:400:kworker.0 00010000:00080000:3.0:1783135537.523541:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543794380 x1869752809150848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135537.523554:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809150848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135537.523687:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783135537.524172:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809149184:0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.524187:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809149696:0@lo:400:kworker.0 00010000:00080000:1.0:1783135537.524199:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3e300 x1869752809150208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135537.524225:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809150208:0@lo:400:kworker.0 00000100:00100000:1.0:1783135537.524242:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809150720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135537.524252:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809149056:0@lo:400:kworker.0 00010000:00080000:1.0:1783135537.524262:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc5180 x1869752809149568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135537.524271:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809149568:0@lo:400:kworker.0 00010000:00080000:1.0:1783135537.524291:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3c700 x1869752809150080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135537.524299:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809150080:0@lo:400:kworker.0 00010000:00080000:1.0:1783135537.524308:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543ad9c00 x1869752809150592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135537.524319:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809150592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135537.524533:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809150336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135537.524606:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809150336:12345-0@lo:400:kworker.0 Request processed in 78us (3395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135537.524847:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809149824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135537.524883:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809149824:12345-0@lo:400:kworker.0 Request processed in 3153us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.530048:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809149824:0@lo:400:kworker.0 00010000:00080000:3.0:1783135537.530070:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3d500 x1869752809150336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135537.530081:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809150336:0@lo:400:kworker.0 00000100:00100000:2.0:1783135537.531006:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783135537.531122:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 10000000:01000000:3.0:1783135537.710224:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135537.710232:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac67e2d9800 from 7 10000000:01000000:3.0:1783135537.710237:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135537.710323:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.710336:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.710349:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135537.710376:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809150976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.710448:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135537.710683:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809150976 00000100:00100000:2.0:1783135537.710691:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809150976 00000100:00100000:2.0:1783135537.710754:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1783135537.710764:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:6519:x1869752809150976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135537.710799:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135537.710815:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfc5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfc55 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135537.710842:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfc5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfc55 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135537.710853:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfc5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfc55 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135537.710863:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f000, rc 0) 00000100:00100000:2.0:1783135537.710901:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809150976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.710908:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1783135537.711348:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.711373:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809150976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135537.711389:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.711400:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135537.711468:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809151104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.711641:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.711663:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135537.715734:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809151104 00000100:00100000:1.0:1783135537.715751:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809151104 00000100:00100000:1.0:1783135537.716235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1783135537.716249:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809151104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135537.716463:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809151104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (4821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135537.716483:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1783135537.716604:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809151104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.716658:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809151232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.716721:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.723050:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135537.725832:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809151232 00000100:00100000:2.0:1783135537.725919:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809151232 00000100:00100000:2.0:1783135537.725995:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1783135537.726007:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809151232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135537.726556:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809151232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 549us (9833us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.726567:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1783135537.727799:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809151232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.730532:0:13809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13809:1869752809151360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135537.730781:0:13809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.730971:0:13809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135537.731208:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809151360 00000100:00100000:2.0:1783135537.731216:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809151360 00000100:00100000:2.0:1783135537.731598:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1783135537.731610:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:13809:x1869752809151360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135537.731778:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:13809:x1869752809151360:12345-0@lo:502:llog_process_th.0 Request processed in 170us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.731796:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1783135537.732135:0:13809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13809:1869752809151360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135537.732180:0:13809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135537.732193:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135537.732195:0:13809:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135537.732202:0:13809:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac67e2d9800 00000020:00000080:3.0:1783135537.732204:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135537.732261:0:13809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135537.744931:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135537.744940:0:13809:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135537.744953:0:13809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135537.744961:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135537.744962:0:13809:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783135537.744968:0:13809:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac67e2d9800 00000020:00000080:3.0:1783135537.744971:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783135537.745444:0:13809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13809:1869752809151488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135537.745553:0:13809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.745615:0:13809:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135537.745830:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809151488 00000100:00100000:2.0:1783135537.745838:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809151488 00000100:00100000:2.0:1783135537.745898:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1783135537.745907:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:13809:x1869752809151488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135537.746052:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:13809:x1869752809151488:12345-0@lo:502:llog_process_th.0 Request processed in 146us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.746060:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1783135537.746213:0:13809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13809:1869752809151488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135537.746240:0:13809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135537.746247:0:13809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135537.746248:0:13809:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783135537.746252:0:13809:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1783135537.746969:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1783135537.747009:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135537.747020:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135537.747031:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135537.747041:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135537.747043:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac67c2fd800 from 7 10000000:01000000:2.0:1783135537.747046:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135537.747170:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135537.747179:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135537.747188:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135537.747207:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809151616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135537.747257:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135537.747499:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac673802b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.752662:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809151616 00000100:00100000:3.0:1783135537.752678:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809151616 00000100:00100000:3.0:1783135537.752756:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1783135537.752779:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:6519:x1869752809151616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135537.752797:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135537.752814:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edfc6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfc63 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.752844:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edfc6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfc63 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.752855:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edfc6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfc63 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.752864:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527000, rc 0) 00000100:00100000:3.0:1783135537.752947:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809151616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (5688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.752954:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1783135537.753963:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809151616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135537.753992:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.754016:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135537.754341:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809151744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135537.754395:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.754487:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6611299c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.755769:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809151744 00000100:00100000:3.0:1783135537.755780:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809151744 00000100:00100000:3.0:1783135537.755890:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1783135537.755900:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809151744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.756106:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658032450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809151744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.756115:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1783135537.756332:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809151744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135537.756384:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809151872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135537.756439:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.756731:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6611299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135537.756855:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809151872 00000100:00100000:2.0:1783135537.756861:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809151872 00000100:00100000:2.0:1783135537.756892:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1783135537.756900:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809151872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135537.757001:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809151872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.757008:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1783135537.763622:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809151872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135537.764289:0:13812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13812:1869752809152000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135537.764449:0:13812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.764510:0:13812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac647d9f600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.764757:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809152000 00000100:00100000:3.0:1783135537.764765:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809152000 00000100:00100000:3.0:1783135537.764829:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1783135537.764840:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:13812:x1869752809152000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135537.764982:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:13812:x1869752809152000:12345-0@lo:502:llog_process_th.0 Request processed in 143us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.765002:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1783135537.765137:0:13812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13812:1869752809152000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135537.765168:0:13812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135537.765178:0:13812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135537.765180:0:13812:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783135537.765187:0:13812:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac67c2fd800 00000020:00000080:1.0:1783135537.765190:0:13812:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135537.765251:0:13812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135537.765255:0:13812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135537.765257:0:13812:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783135537.765260:0:13812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135537.765263:0:13812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135537.765271:0:13812:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783135537.765277:0:13812:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac67c2fd800 00000020:00000080:1.0:1783135537.765280:0:13812:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783135537.765336:0:13812:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13812:1869752809152128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135537.765390:0:13812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135537.765415:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809152128 00000100:00100000:1.0:1783135537.765418:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809152128 00000100:00100000:1.0:1783135537.765445:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1783135537.765453:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:13812:x1869752809152128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135537.765533:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658033c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:13812:x1869752809152128:12345-0@lo:502:llog_process_th.0 Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135537.765540:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1783135537.765572:0:13812:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6611299c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135537.765586:0:13812:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13812:1869752809152128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135537.765602:0:13812:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135537.765606:0:13812:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135537.765608:0:13812:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783135537.765611:0:13812:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783135537.766460:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783135537.766507:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135537.766519:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.766532:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135537.766547:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135537.766550:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac6743ed800 from 7 10000000:01000000:3.0:1783135537.766554:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135537.766586:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.766594:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.766603:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135537.766622:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809152256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.766669:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.766705:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.766724:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809152256 00000100:00100000:3.0:1783135537.766729:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809152256 00000100:00100000:3.0:1783135537.766766:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1783135537.766774:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:6519:x1869752809152256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135537.766783:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135537.766803:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edfc78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfc71 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.766843:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edfc78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfc71 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.766853:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edfc78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfc71 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.766860:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527600, rc 0) 00000100:00100000:3.0:1783135537.766898:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809152256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.766905:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1783135537.766948:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809152256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135537.766961:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.766971:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135537.767024:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809152384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.767049:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.767062:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.767073:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809152384 00000100:00100000:3.0:1783135537.767076:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809152384 00000100:00100000:3.0:1783135537.767126:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783135537.767134:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809152384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.767240:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809152384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.767254:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1783135537.767283:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809152384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.767315:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809152512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.767354:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.767374:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.767384:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809152512 00000100:00100000:3.0:1783135537.767388:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809152512 00000100:00100000:3.0:1783135537.767407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1783135537.767413:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809152512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.767501:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809152512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.767508:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1783135537.767554:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809152512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.767746:0:13813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13813:1869752809152640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135537.767793:0:13813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.767810:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809152640 00000100:00100000:3.0:1783135537.767814:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809152640 00000100:00100000:3.0:1783135537.767834:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1783135537.767840:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:13813:x1869752809152640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135537.767903:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:13813:x1869752809152640:12345-0@lo:502:llog_process_th.0 Request processed in 62us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.767910:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1783135537.767941:0:13813:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.767953:0:13813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13813:1869752809152640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135537.767978:0:13813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135537.767987:0:13813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135537.767989:0:13813:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135537.767995:0:13813:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac6743ed800 00000020:00000080:3.0:1783135537.767997:0:13813:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135537.768053:0:13813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135537.768130:0:13813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135537.768134:0:13813:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783135537.768146:0:13813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135537.768150:0:13813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135537.768151:0:13813:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783135537.768156:0:13813:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac6743ed800 00000020:00000080:2.0:1783135537.768159:0:13813:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783135537.768210:0:13813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13813:1869752809152768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135537.768250:0:13813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135537.768273:0:13813:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac542463840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.768494:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809152768 00000100:00100000:3.0:1783135537.768499:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809152768 00000100:00100000:3.0:1783135537.768537:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1783135537.768544:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:13813:x1869752809152768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135537.768621:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:13813:x1869752809152768:12345-0@lo:502:llog_process_th.0 Request processed in 77us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.768627:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1783135537.770364:0:13813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13813:1869752809152768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783135537.770407:0:13813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135537.770426:0:13813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135537.770429:0:13813:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1783135537.770439:0:13813:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783135537.770832:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783135537.770862:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135537.770874:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.770891:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135537.770902:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135537.770904:0:6519:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac64382e000 from 7 10000000:01000000:3.0:1783135537.770907:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135537.770943:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.770951:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.770973:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135537.770997:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809152896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.771055:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.771131:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135537.771194:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809152896 00000100:00100000:1.0:1783135537.771200:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809152896 00000100:00100000:1.0:1783135537.771251:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1783135537.771261:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:6519:x1869752809152896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135537.771276:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135537.771289:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628edfc7f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.771328:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628edfc7f expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.771355:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628edfc7f expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135537.771373:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51ae00, rc 0) 00000100:00100000:1.0:1783135537.771415:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809152896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135537.771421:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1783135537.771645:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809152896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135537.771661:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.771671:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135537.771741:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809153024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.771771:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.771795:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7900 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.771811:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809153024 00000100:00100000:3.0:1783135537.771814:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809153024 00000100:00100000:3.0:1783135537.771836:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1783135537.771843:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809153024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.771959:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809153024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.771966:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1783135537.771997:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809153024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.772026:0:6519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809153152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.772073:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.772128:0:6519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7900 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.772140:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809153152 00000100:00100000:3.0:1783135537.772144:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809153152 00000100:00100000:3.0:1783135537.772161:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1783135537.772167:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809153152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.772241:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:6519:x1869752809153152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.772247:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1783135537.772285:0:6519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:6519:1869752809153152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.772663:0:13814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13814:1869752809153280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135537.772700:0:13814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.772720:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809153280 00000100:00100000:3.0:1783135537.772724:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809153280 00000100:00100000:3.0:1783135537.772742:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1783135537.772747:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:13814:x1869752809153280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135537.772820:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:13814:x1869752809153280:12345-0@lo:502:llog_process_th.0 Request processed in 72us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.772826:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1783135537.772852:0:13814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7240 going to sleep for 11 seconds 00000100:00100000:3.0:1783135537.772864:0:13814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13814:1869752809153280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135537.772884:0:13814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135537.772894:0:13814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135537.772896:0:13814:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135537.772904:0:13814:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac64382e000 00000020:00000080:3.0:1783135537.772911:0:13814:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135537.772963:0:13814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135537.773276:0:13814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135537.773279:0:13814:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135537.773283:0:13814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135537.773287:0:13814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135537.773288:0:13814:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783135537.773292:0:13814:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac64382e000 00000020:00000080:3.0:1783135537.773295:0:13814:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783135537.774003:0:13814:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13814:1869752809153408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135537.774057:0:13814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135537.774167:0:13814:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135537.774538:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809153408 00000100:00100000:1.0:1783135537.774545:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809153408 00000100:00100000:1.0:1783135537.774632:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1783135537.774642:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:13814:x1869752809153408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135537.774785:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:13814:x1869752809153408:12345-0@lo:502:llog_process_th.0 Request processed in 144us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135537.774792:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1783135537.774872:0:13814:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:13814:1869752809153408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135537.774901:0:13814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135537.774907:0:13814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135537.774909:0:13814:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783135537.774913:0:13814:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783135537.774989:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1783135537.775007:0:6519:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135537.775016:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.775025:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135537.781040:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1783135537.826613:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783135537.846937:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135537.847047:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785990528 00000100:00100000:3.0:1783135537.847059:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785990528 00000100:00100000:3.0:1783135537.847148:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 369 00000100:00100000:3.0:1783135537.847159:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:6176:x1869752785990528:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135537.847188:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135537.847206:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfc8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140be8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.847234:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfc8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140be8 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.847246:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfc8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140be8 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135537.847256:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526a00, rc 0) 00000100:00100000:3.0:1783135537.847308:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785990528:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 151us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.847316:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 369 00000100:00100000:2.0:1783135537.855182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135537.855264:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785990656 00000100:00100000:3.0:1783135537.855274:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785990656 00000100:00100000:3.0:1783135537.855339:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 370 00000100:00100000:3.0:1783135537.855350:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785990656:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.855529:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785990656:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 181us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.855538:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 370 00000100:00100000:2.0:1783135537.862144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135537.862844:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785990784 00000100:00100000:1.0:1783135537.862856:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785990784 00000100:00100000:1.0:1783135537.862948:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 371 00000100:00100000:1.0:1783135537.862958:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785990784:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135537.863116:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785990784:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 159us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135537.863124:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 371 00000100:00100000:2.0:1783135537.867744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135537.868059:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785990912 00000100:00100000:3.0:1783135537.868069:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785990912 00000100:00100000:3.0:1783135537.868147:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 372 00000100:00100000:3.0:1783135537.868158:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:10804:x1869752785990912:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135537.868354:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:10804:x1869752785990912:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 197us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.868376:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 372 00000100:00100000:2.0:1783135537.875551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135537.875869:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785991040 00000100:00100000:1.0:1783135537.875881:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785991040 00000100:00100000:1.0:1783135537.875950:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 373 00000100:00100000:1.0:1783135537.875960:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:10804:x1869752785991040:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135537.876198:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:10804:x1869752785991040:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 238us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135537.876207:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 373 00000100:00100000:2.0:1783135537.895658:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135537.895787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785991168 00000100:00100000:0.0:1783135537.895799:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785991168 00000100:00100000:0.0:1783135537.895857:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 374 00000100:00100000:0.0:1783135537.895867:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac65803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:6176:x1869752785991168:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135537.895884:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135537.895953:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac650988200/0xf7de4ef628edfc94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140bef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135537.895984:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650988200/0xf7de4ef628edfc94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bef expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135537.895996:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac650988200/0xf7de4ef628edfc94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bef expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135537.896006:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988200, rc 0) 00000100:00100000:0.0:1783135537.896119:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac65803d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:6176:x1869752785991168:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 253us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135537.896128:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 374 00000100:00100000:2.0:1783135537.903976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135537.904676:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785991296 00000100:00100000:3.0:1783135537.904688:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785991296 00000100:00100000:3.0:1783135537.906532:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 375 00000100:00100000:3.0:1783135537.906566:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac641681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:6176:x1869752785991296:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135537.907354:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac641681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:6176:x1869752785991296:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 803us (3384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.907515:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 375 00000100:00100000:1.0:1783135537.913932:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135537.914019:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785991424 00000100:00100000:2.0:1783135537.914029:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785991424 00000100:00100000:2.0:1783135537.914121:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 376 00000100:00100000:2.0:1783135537.914132:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:6176:x1869752785991424:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135537.914270:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:6176:x1869752785991424:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 140us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135537.914278:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 376 00000100:00100000:3.0:1783135537.920589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135537.920957:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785991552 00000100:00100000:1.0:1783135537.920967:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785991552 00000100:00100000:1.0:1783135537.921035:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 377 00000100:00100000:1.0:1783135537.921045:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:10807:x1869752785991552:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135537.921253:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b580050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:10807:x1869752785991552:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 208us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135537.921261:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 377 00000100:00100000:1.0:1783135537.929672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135537.929869:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785991680 00000100:00100000:3.0:1783135537.929880:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785991680 00000100:00100000:3.0:1783135537.929940:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 378 00000100:00100000:3.0:1783135537.929950:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:10807:x1869752785991680:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135537.930134:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:10807:x1869752785991680:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 184us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135537.930143:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 378 00010000:00010000:3.0:1783135538.030275:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135538.798788:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1783135538.865354:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135539.054549:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135540.080688:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135540.592251:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135540.599070:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809153536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135540.599231:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135540.599739:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809153536 00000100:00100000:0.0:1783135540.599750:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809153536 00000100:00100000:0.0:1783135540.599828:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783135540.599839:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809153536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135540.599884:0:13344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135540.599964:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809153536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135540.599981:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783135540.600153:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809153536:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135541.102727:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783135541.107929:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1783135541.836481:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135541.836646:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135541.836774:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135541.836804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135541.836826:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785992192 00000100:00100000:0.0:1783135541.836827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135541.836839:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785992192 00000100:00100000:0.0:1783135541.836861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135541.836919:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785991936 00000100:00100000:0.0:1783135541.836924:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785991936 00000100:00100000:3.0:1783135541.836930:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:3.0:1783135541.836951:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785992192:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135541.836963:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785992448 00000100:00100000:0.0:1783135541.836967:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785992448 00000100:00100000:0.0:1783135541.836983:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785992064 00000100:00100000:0.0:1783135541.836986:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785992064 00000100:00100000:0.0:1783135541.837001:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785992320 00000100:00100000:0.0:1783135541.837003:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785992320 00000100:00100000:3.0:1783135541.837037:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785992192:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135541.837043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 270 00000100:00100000:3.0:1783135541.837052:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:0.0:1783135541.837059:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785991936:12345-192.168.204.6@tcp:400:kworker.0 00000100:00080000:3.0:1783135541.837081:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135541.837128:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135541.837132:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135541.837150:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 271 00000100:00100000:0.0:1783135541.837157:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752785991936:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 101us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135541.837161:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785992448:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135541.837171:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 270 00000100:00100000:0.0:1783135541.837189:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 272 00000100:00100000:0.0:1783135541.837197:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752785992064:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135541.837203:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752785992448:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 43us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135541.837211:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 271 00000100:00100000:3.0:1783135541.837234:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 273 00000100:00100000:0.0:1783135541.837235:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752785992064:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 35us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135541.837245:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752785992320:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135541.837246:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 272 00000100:00100000:3.0:1783135541.837279:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752785992320:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 37us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135541.837299:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 273 00000100:00100000:1.0:1783135541.842542:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785991808 00000100:00100000:1.0:1783135541.842558:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785991808 00000100:00100000:1.0:1783135541.842789:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 379 00000100:00100000:1.0:1783135541.842802:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2401:x1869752785991808:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135541.843315:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b580850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2401:x1869752785991808:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 513us (6845us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135541.843325:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 379 00010000:00010000:1.0:1783135542.127686:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135542.638326:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809153664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135542.638356:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809153792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135542.638416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135542.638444:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135542.638530:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809153920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135542.638573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135542.638846:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809153792 00000100:00100000:1.0:1783135542.638854:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809153792 00000100:00100000:1.0:1783135542.638910:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809153920 00000100:00100000:1.0:1783135542.638913:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809153920 00000100:00100000:1.0:1783135542.638951:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783135542.638960:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809153792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135542.638990:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135542.639032:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809153792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135542.639040:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783135542.639057:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783135542.639063:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809153920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135542.639074:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135542.639197:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809154176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135542.639224:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135542.647371:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809154048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135542.647485:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135542.647524:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135542.647532:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809154432:0@lo:400:kworker.0 00000100:00100000:2.0:1783135542.647561:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135542.647599:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809154176 00000100:00100000:2.0:1783135542.647609:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809154176 00000100:00100000:2.0:1783135542.647719:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809154048 00000100:00100000:2.0:1783135542.647724:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809154048 00000100:00100000:2.0:1783135542.647746:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783135542.647755:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809154176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135542.647797:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135542.647844:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809154176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (8617us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135542.647851:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1783135542.647868:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783135542.647892:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809154048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135542.647905:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135542.647939:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809154048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135542.648860:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783135542.648915:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809154432 00000100:00100000:2.0:1783135542.648921:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809154432 00000100:00100000:2.0:1783135542.649454:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1783135542.649465:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809154432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135542.649557:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809154432:12345-0@lo:400:kworker.0 Request processed in 95us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135542.649579:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783135542.650204:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809153792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135542.650250:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809154304:0@lo:400:kworker.0 00000100:00100000:3.0:1783135542.650305:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135542.650363:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809153664 00000100:00100000:3.0:1783135542.650369:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809153664 00000100:00100000:3.0:1783135542.650440:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783135542.650447:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809153664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135542.650479:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1783135542.650521:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809153664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (12106us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135542.650528:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783135542.650553:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809154304 00000100:00100000:3.0:1783135542.650557:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809154304 00000100:00100000:3.0:1783135542.650582:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1783135542.650589:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809154304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135542.650621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809154304:12345-0@lo:400:kworker.0 Request processed in 33us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135542.650627:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1783135542.650668:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809154304:0@lo:400:kworker.0 00000100:00100000:1.0:1783135542.650702:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809153920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11635us (12124us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135542.650712:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783135542.650721:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809154432:0@lo:400:kworker.0 00000100:00100000:2.0:1783135542.650738:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000100:00080000:1.0:1783135542.650741:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783135542.650744:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543ad8a80 x1869752809154048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1783135542.650746:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac543794a80, transno 4294967301 00000100:00080000:1.0:1783135542.650749:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135542.650765:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809154048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135542.650770:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809153920:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1783135542.650825:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a3d180 x1869752809154176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135542.650839:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809154176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135542.650854:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809153664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135542.651509:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135542.651520:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809154688:0@lo:400:kworker.0 00000100:00100000:0.0:1783135542.651557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135542.651615:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809154688 00000100:00100000:0.0:1783135542.651620:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809154688 00000100:00100000:1.0:1783135542.652755:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783135542.652771:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809154688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135542.652842:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809154688:12345-0@lo:400:kworker.0 Request processed in 75us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135542.652849:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783135542.652892:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809154816:0@lo:400:kworker.0 00000100:00100000:1.0:1783135542.653119:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135542.653171:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809154688:0@lo:400:kworker.0 00000100:00100000:1.0:1783135542.653188:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135542.653193:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809155200:0@lo:400:kworker.0 00000100:00100000:1.0:1783135542.653215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135542.653251:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809154816 00000100:00100000:1.0:1783135542.653256:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809154816 00000100:00100000:1.0:1783135542.653297:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809155200 00000100:00100000:1.0:1783135542.653300:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809155200 00000100:00100000:1.0:1783135542.653321:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1783135542.653328:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809154816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135542.653365:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809154816:12345-0@lo:400:kworker.0 Request processed in 38us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135542.653371:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1783135542.653397:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1783135542.653404:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809155200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135542.653434:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809155200:12345-0@lo:400:kworker.0 Request processed in 30us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135542.653440:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:1.0:1783135542.653456:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135542.653460:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783135542.653588:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54379f100 x1869752809155200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135542.654135:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809154560:0@lo:400:kworker.0 00000100:00100000:3.0:1783135542.654187:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135542.654221:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809155072:0@lo:400:kworker.0 00000100:00100000:3.0:1783135542.654256:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135542.654279:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135542.654285:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809154944:0@lo:400:kworker.0 00000100:00100000:3.0:1783135542.654307:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135542.654329:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809154560 00000100:00100000:3.0:1783135542.654333:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809154560 00000100:00100000:3.0:1783135542.654356:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809155072 00000100:00100000:3.0:1783135542.654359:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809155072 00000100:00100000:3.0:1783135542.654395:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809154944 00000100:00100000:3.0:1783135542.654398:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809154944 00000100:00100000:2.0:1783135542.654410:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1783135542.654435:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809154560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135542.654491:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809154560:12345-0@lo:400:kworker.0 Request processed in 60us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135542.654560:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809155200:0@lo:400:kworker.0 00000100:00100000:1.0:1783135542.654651:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809154816:0@lo:400:kworker.0 00000100:00100000:3.0:1783135542.656901:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1783135542.656928:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809155072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135542.657024:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809155072:12345-0@lo:400:kworker.0 Request processed in 110us (2767us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135542.657032:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1783135542.657053:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1783135542.657061:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809154944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135542.657108:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809154944:12345-0@lo:400:kworker.0 Request processed in 48us (2799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135542.657114:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:3.0:1783135542.657144:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135542.657150:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783135542.657222:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54379f800 x1869752809154944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135542.657238:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809154944:0@lo:400:kworker.0 00000100:00100000:3.0:1783135542.657272:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809154560:0@lo:400:kworker.0 00000100:00100000:3.0:1783135542.657283:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809155072:0@lo:400:kworker.0 00000100:00100000:2.0:1783135542.660167:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00010000:0.0:1783135543.150391:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135544.174561:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135545.198290:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135545.710986:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809155328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135545.711113:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135545.711248:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809155328 00000100:00100000:0.0:1783135545.711256:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809155328 00000100:00100000:0.0:1783135545.711333:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783135545.711344:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809155328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135545.711386:0:13344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135545.711456:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809155328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135545.711463:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783135545.711626:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809155328:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135546.223442:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135546.934358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135546.934411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135546.934443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135546.934464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135546.934494:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135546.934540:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135546.934571:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785992832 00000100:00100000:0.0:1783135546.934581:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785992832 00000100:00100000:0.0:1783135546.934656:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785993088 00000100:00100000:0.0:1783135546.934659:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785993088 00000100:00100000:0.0:1783135546.934673:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785992704 00000100:00100000:0.0:1783135546.934675:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785992704 00000100:00100000:0.0:1783135546.934685:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785993216 00000100:00100000:0.0:1783135546.934687:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785993216 00000100:00100000:0.0:1783135546.934701:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 280 00000100:00100000:0.0:1783135546.934710:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785992832:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135546.934802:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785992832:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 92us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135546.934826:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 280 00000100:00100000:0.0:1783135546.934844:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 281 00000100:00100000:0.0:1783135546.934863:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785993088:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135546.934896:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785993088:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 33us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135546.934902:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 281 00000100:00100000:0.0:1783135546.934913:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 282 00000100:00100000:0.0:1783135546.934920:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785992704:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135546.934941:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785992576 00000100:00100000:2.0:1783135546.934948:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785992576 00000100:00100000:0.0:1783135546.934948:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785992704:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135546.934956:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 282 00000100:00100000:0.0:1783135546.934973:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 283 00000100:00100000:0.0:1783135546.934980:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785993216:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135546.934988:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 381 00000100:00100000:2.0:1783135546.934999:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752785992576:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135546.935006:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752785993216:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135546.935017:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 283 00000100:00100000:2.0:1783135546.935048:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b582850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752785992576:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 51us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135546.935057:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 381 00000100:00100000:2.0:1783135546.935144:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785992960 00000100:00100000:2.0:1783135546.935148:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785992960 00000100:00100000:2.0:1783135546.935188:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:2.0:1783135546.935195:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785992960:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135546.935223:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785992960:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135546.935230:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00080000:3.0:1783135546.935532:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135546.935538:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135546.935540:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783135547.248288:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135547.759395:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809155456:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.759507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.759567:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809155968:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.759600:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.759620:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809156480:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.759644:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.759662:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809156992:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.759684:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.759709:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1783135547.759717:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809155584:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.759744:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.759762:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809156096:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.759783:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.759800:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809156608:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.759898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.759919:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809157120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135547.759946:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.759982:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809155712:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.760013:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.760038:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809156224:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.760060:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.760078:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809156736:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.760128:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.760146:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809157248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135547.760164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.760184:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1783135547.760190:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809155840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.760211:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.760219:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809156352:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.760236:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.760252:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809156864:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.760272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.760302:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809157376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135547.760327:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.760373:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809155456 00000100:00100000:2.0:1783135547.760382:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809155456 00000100:00100000:2.0:1783135547.760443:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1783135547.760454:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809155456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.760513:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b581050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809155456:12345-0@lo:400:kworker.0 Request processed in 60us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135547.760521:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1783135547.760562:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809155968 00000100:00100000:2.0:1783135547.760566:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809155968 00000100:00100000:2.0:1783135547.760589:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809155712 00000100:00100000:2.0:1783135547.760592:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809155712 00000100:00100000:1.0:1783135547.761179:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809157120 00000100:00100000:1.0:1783135547.761186:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809157120 00000100:00100000:1.0:1783135547.761229:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809157376 00000100:00100000:1.0:1783135547.761232:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809157376 00000100:00100000:1.0:1783135547.761250:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783135547.761257:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809157120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135547.761297:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135547.761356:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809157120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.761363:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783135547.761377:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783135547.761384:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809157376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135547.761395:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135547.761427:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809157376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.761433:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1783135547.761453:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809155584 00000100:00100000:1.0:1783135547.761457:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809155584 00000100:00100000:1.0:1783135547.761478:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809156096 00000100:00100000:1.0:1783135547.761481:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809156096 00000100:00100000:1.0:1783135547.761492:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809156608 00000100:00100000:1.0:1783135547.761495:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809156608 00000100:00100000:1.0:1783135547.761507:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809156224 00000100:00100000:1.0:1783135547.761510:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809156224 00000100:00100000:1.0:1783135547.761521:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809156736 00000100:00100000:1.0:1783135547.761523:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809156736 00000100:00100000:1.0:1783135547.761535:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809155840 00000100:00100000:1.0:1783135547.761550:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809155840 00000100:00100000:1.0:1783135547.761568:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783135547.761574:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809155584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.761608:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809155584:12345-0@lo:400:kworker.0 Request processed in 35us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.761614:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1783135547.761627:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1783135547.761633:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809156096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.761674:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809156096:12345-0@lo:400:kworker.0 Request processed in 41us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.761680:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1783135547.761691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783135547.761697:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809156608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.761725:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809156608:12345-0@lo:400:kworker.0 Request processed in 29us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.761730:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783135547.761741:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1783135547.761746:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809156224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.761770:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809156224:12345-0@lo:400:kworker.0 Request processed in 25us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.761775:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1783135547.761785:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1783135547.761790:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809156736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.761815:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809156736:12345-0@lo:400:kworker.0 Request processed in 25us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.761830:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1783135547.761843:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1783135547.761848:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809155840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.761880:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809155840:12345-0@lo:400:kworker.0 Request processed in 32us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.761885:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1783135547.761982:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809157248 00000100:00100000:2.0:1783135547.762052:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809157248 00000100:00100000:2.0:1783135547.762075:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783135547.762084:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809155968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.762129:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809156480 00000100:00100000:1.0:1783135547.762134:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809156480 00000100:00100000:1.0:1783135547.762157:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809156992 00000100:00100000:1.0:1783135547.762161:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809156992 00000100:00100000:1.0:1783135547.762170:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809156352 00000100:00100000:1.0:1783135547.762172:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809156352 00000100:00100000:1.0:1783135547.762182:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809156864 00000100:00100000:1.0:1783135547.762184:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809156864 00000100:00100000:1.0:1783135547.762195:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783135547.762201:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809156480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.762237:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809156480:12345-0@lo:400:kworker.0 Request processed in 36us (2591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.762244:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783135547.762255:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783135547.762261:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809156992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.762301:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809156992:12345-0@lo:400:kworker.0 Request processed in 40us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.762308:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783135547.762319:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783135547.762325:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809156352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.762379:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809156352:12345-0@lo:400:kworker.0 Request processed in 53us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.762385:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783135547.762397:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783135547.762403:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809156864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135547.762429:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809156864:12345-0@lo:400:kworker.0 Request processed in 27us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135547.762435:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783135547.762507:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809155968:12345-0@lo:400:kworker.0 Request processed in 424us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135547.762514:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783135547.762528:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783135547.762534:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809155712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.762563:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809155712:12345-0@lo:400:kworker.0 Request processed in 30us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135547.762569:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783135547.762580:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783135547.762586:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809157248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135547.762611:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783135547.762646:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809157248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135547.762652:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783135547.762707:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809157632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135547.762751:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.762785:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135547.762792:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809157504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135547.762831:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135547.762865:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809157632 00000100:00100000:2.0:1783135547.762869:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809157632 00000100:00100000:2.0:1783135547.762893:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809157504 00000100:00100000:2.0:1783135547.762895:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809157504 00000100:00100000:2.0:1783135547.762908:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783135547.762915:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809157632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135547.762937:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135547.762973:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809157632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135547.762979:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1783135547.762986:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135547.762993:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135547.762996:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135547.762998:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135547.763152:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783135547.763162:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809157504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135547.763174:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135547.763234:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809155840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.763571:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809157504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 410us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135547.763579:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783135547.763582:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809156352:0@lo:400:kworker.0 00010000:00080000:3.0:1783135547.763605:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5437a7800 x1869752809156864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135547.763617:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809156864:0@lo:400:kworker.0 00000100:00100000:2.0:1783135547.763624:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809157504:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1783135547.763635:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b9b800 x1869752809157376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135547.763644:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809157632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135547.763652:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809157376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135547.763671:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809155712:0@lo:400:kworker.0 00010000:00080000:3.0:1783135547.763682:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84f800 x1869752809156224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135547.763690:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809156224:0@lo:400:kworker.0 00010000:00080000:3.0:1783135547.763714:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67f84dc00 x1869752809156736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135547.763722:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809156736:0@lo:400:kworker.0 00000100:00100000:3.0:1783135547.763736:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809157248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135547.763991:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809155584:0@lo:400:kworker.0 00000100:00100000:3.0:1783135547.764008:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809156096:0@lo:400:kworker.0 00000100:00100000:3.0:1783135547.764020:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809156608:0@lo:400:kworker.0 00010000:00080000:3.0:1783135547.764031:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5437a4a80 x1869752809157120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135547.764044:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809157120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135547.764055:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809155456:0@lo:400:kworker.0 00000100:00100000:3.0:1783135547.764068:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809155968:0@lo:400:kworker.0 00000100:00100000:3.0:1783135547.764079:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809156480:0@lo:400:kworker.0 00010000:00080000:3.0:1783135547.764108:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5437a4e00 x1869752809156992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135547.764115:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809156992:0@lo:400:kworker.0 00000040:00080000:0.0:1783135548.015017:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1783135548.078885:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783135548.270293:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135549.294365:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135550.319957:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135550.830404:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135550.830431:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809157760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135550.830517:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135550.830668:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809157760 00000100:00100000:0.0:1783135550.830677:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809157760 00000100:00100000:0.0:1783135550.830738:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783135550.830749:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809157760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135550.830786:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135550.830847:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809157760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135550.830860:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783135550.831120:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809157760:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135551.342380:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135552.056972:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135552.057052:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135552.057183:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785993472 00000100:00100000:1.0:1783135552.057194:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785993472 00000100:00100000:1.0:1783135552.057290:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 290 00000100:00100000:1.0:1783135552.057302:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785993472:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135552.057383:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785993472:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135552.057403:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 290 00000100:00080000:0.0:1783135552.057692:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135552.058160:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785993344 00000100:00100000:3.0:1783135552.058167:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785993344 00000100:00100000:3.0:1783135552.058224:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 383 00000100:00100000:3.0:1783135552.058232:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752785993344:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135552.069692:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b582050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752785993344:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 11446us (12717us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135552.069709:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 383 00000100:00100000:1.0:1783135552.073164:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135552.074493:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785993600 00000100:00100000:0.0:1783135552.074508:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785993600 00000100:00100000:0.0:1783135552.074602:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 291 00000100:00100000:0.0:1783135552.074616:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785993600:12345-192.168.204.6@tcp:400:kworker.0 00000100:00080000:3.0:1783135552.074695:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135552.074714:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752785993600:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 100us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.074722:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 291 00000100:00100000:3.0:1783135552.074750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135552.074850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135552.074889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135552.074902:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785993728 00000100:00100000:1.0:1783135552.074908:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785993728 00000100:00100000:3.0:1783135552.074918:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785993856 00000100:00100000:3.0:1783135552.074923:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785993856 00000100:00100000:1.0:1783135552.074952:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:1.0:1783135552.074961:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2397:x1869752785993728:12345-192.168.204.6@tcp:9:kworker.0 00000100:00100000:3.0:1783135552.074964:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785993984 00000100:00100000:3.0:1783135552.074968:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785993984 00000020:00000080:1.0:1783135552.074985:0:8620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edfbbb 00000100:00100000:3.0:1783135552.074993:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 292 00000100:00080000:1.0:1783135552.074996:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8ac67f83b800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783135552.075003:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785993856:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135552.075044:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785993856:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 44us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135552.075051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 292 00000001:00000004:1.0:1783135552.075063:0:8620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1783135552.075068:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 293 00000100:00100000:3.0:1783135552.075077:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785993984:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135552.075135:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785993984:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 58us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135552.075143:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 293 00010000:00010000:3.0:1783135552.075162:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783135552.075171:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135552.075174:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135552.075193:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135552.075242:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+2:2397:x1869752785993728:12345-192.168.204.6@tcp:9:kworker.0 Request processed in 283us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135552.075259:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 27 00010000:00010000:3.0:1783135552.366531:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135552.878466:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135552.878491:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809157888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135552.878567:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.879164:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809157888 00000100:00100000:2.0:1783135552.879174:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809157888 00000100:00100000:2.0:1783135552.879244:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783135552.879256:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809157888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135552.879318:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783135552.879386:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809157888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135552.879394:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783135552.879417:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135552.879440:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809158016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135552.879476:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.879515:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809158016 00000100:00100000:2.0:1783135552.879518:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809158016 00000100:00100000:2.0:1783135552.879553:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783135552.879560:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809158016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135552.879592:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135552.879627:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809158016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135552.879634:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1783135552.879649:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135552.879747:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809158144:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.879795:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.879816:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809158656:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.879859:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.879877:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809159168:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.879898:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783135552.879927:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac652ae8e00 x1869752809158016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135552.879946:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809158016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135552.879963:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783135552.879969:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809158528:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.879991:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.880005:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809159040:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.880026:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.880052:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809159040 00000100:00100000:2.0:1783135552.880056:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809159040 00000100:00100000:2.0:1783135552.880116:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783135552.880124:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809159040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.880157:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809159040:12345-0@lo:400:kworker.0 Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135552.880162:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1783135552.880177:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135552.880187:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809158272:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.880219:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.880235:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809158784:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.880271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.880295:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809159296:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.880326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.880355:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809157888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135552.880367:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783135552.880372:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809158400:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.880394:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.880404:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809158912:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.880422:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.880437:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809159424:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.880457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.880484:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809159040:0@lo:400:kworker.0 00000100:00100000:0.0:1783135552.881158:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809158528 00000100:00100000:0.0:1783135552.881166:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809158528 00000100:00100000:1.0:1783135552.881175:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809158912 00000100:00100000:1.0:1783135552.881181:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809158912 00000100:00100000:0.0:1783135552.881220:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783135552.881232:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809158528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135552.881236:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809159424 00000100:00100000:1.0:1783135552.881241:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809159424 00000100:00100000:1.0:1783135552.881281:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783135552.881292:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809158912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135552.881302:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809158528:12345-0@lo:400:kworker.0 Request processed in 72us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.881311:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783135552.881334:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809158656 00000100:00100000:0.0:1783135552.881338:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809158656 00000100:00100000:1.0:1783135552.881351:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809158912:12345-0@lo:400:kworker.0 Request processed in 60us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135552.881359:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783135552.881364:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809159168 00000100:00100000:0.0:1783135552.881368:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809159168 00000100:00100000:1.0:1783135552.881380:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783135552.881389:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809158272 00000100:00100000:1.0:1783135552.881390:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809159424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135552.881394:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809158272 00000100:00100000:0.0:1783135552.881412:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809158784 00000100:00100000:0.0:1783135552.881415:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809158784 00000100:00100000:0.0:1783135552.881427:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809159296 00000100:00100000:0.0:1783135552.881430:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809159296 00000100:00100000:1.0:1783135552.881439:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809159424:12345-0@lo:400:kworker.0 Request processed in 51us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.881444:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809158400 00000100:00100000:1.0:1783135552.881447:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783135552.881460:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809158400 00000100:00080000:1.0:1783135552.881472:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135552.881478:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135552.881481:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135552.881484:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00080000:1.0:1783135552.881485:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135552.881495:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809158656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135552.881533:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809158912:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.881688:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809159680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135552.881799:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809159552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135552.885663:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809158656:12345-0@lo:400:kworker.0 Request processed in 4154us (5787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.885759:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1783135552.885806:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1783135552.885823:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809159168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135552.887272:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809159168:12345-0@lo:400:kworker.0 Request processed in 1448us (7362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.887286:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1783135552.887320:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1783135552.887330:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809158272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135552.887371:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809158272:12345-0@lo:400:kworker.0 Request processed in 45us (7151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.887378:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1783135552.887390:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1783135552.887398:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809158784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135552.887429:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809158784:12345-0@lo:400:kworker.0 Request processed in 34us (7158us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.887435:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1783135552.887447:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1783135552.887454:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809159296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135552.888224:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809159296:12345-0@lo:400:kworker.0 Request processed in 765us (7891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.888254:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1783135552.888278:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1783135552.888286:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809158400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135552.888337:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809158400:12345-0@lo:400:kworker.0 Request processed in 53us (7942us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.888343:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1783135552.888439:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809158144 00000100:00100000:0.0:1783135552.888448:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809158144 00000100:00100000:0.0:1783135552.889811:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1783135552.890229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809158144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135552.890332:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809158144:12345-0@lo:400:kworker.0 Request processed in 510us (10535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.890341:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1783135552.890594:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135552.890614:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809159808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135552.890658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135552.890726:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809159808 00000100:00100000:0.0:1783135552.890733:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809159808 00000100:00100000:0.0:1783135552.890771:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783135552.890779:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809159808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783135552.890803:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135552.890859:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809159808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.890866:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783135552.890909:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809159808:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1783135552.891808:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac652aebb80 x1869752809159424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135552.891825:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809159424:0@lo:400:kworker.0 00000100:00100000:1.0:1783135552.891845:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809158272:0@lo:400:kworker.0 00010000:00080000:1.0:1783135552.891858:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac652ae9500 x1869752809158784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135552.891879:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809158784:0@lo:400:kworker.0 00010000:00080000:1.0:1783135552.891895:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac652ae9880 x1869752809159296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135552.891902:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809159296:0@lo:400:kworker.0 00000100:00100000:1.0:1783135552.891931:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809158400:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.897133:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135552.897243:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809158528:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.897261:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809158144:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.897290:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809158656:0@lo:400:kworker.0 00000100:00100000:2.0:1783135552.897305:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809159168:0@lo:400:kworker.0 00000100:00100000:0.0:1783135552.897812:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809159680 00000100:00100000:0.0:1783135552.897822:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809159680 00000100:00100000:0.0:1783135552.897892:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783135552.897901:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809159680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135552.897932:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135552.897997:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809159680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135552.898004:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783135552.898244:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809159680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135552.898630:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135552.898732:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809159552 00000100:00100000:0.0:1783135552.898737:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809159552 00000100:00100000:0.0:1783135552.899049:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783135552.899061:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809159552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135552.899080:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135552.899149:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809159552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (584us total) trans 0 rc 0/0 00010000:00080000:3.0:1783135552.899222:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a3d180 x1869752809159552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135552.899241:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809159552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135552.900513:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00010000:1.0:1783135553.392270:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135554.414381:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135555.444858:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135555.950461:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809159936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135555.950543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135555.950575:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809159936 00000100:00100000:1.0:1783135555.950585:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809159936 00000100:00100000:1.0:1783135555.950855:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783135555.950866:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809159936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135555.950919:0:13344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135555.950980:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809159936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135555.950988:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783135555.951065:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809159936:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135556.462238:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135557.175215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135557.175516:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135557.175539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135557.175573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135557.175594:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135557.175685:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785994368 00000100:00100000:1.0:1783135557.175694:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785994368 00000100:00100000:1.0:1783135557.175753:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785994624 00000100:00100000:1.0:1783135557.175756:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785994624 00000100:00100000:1.0:1783135557.175767:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785994240 00000100:00100000:1.0:1783135557.175769:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785994240 00000100:00100000:1.0:1783135557.175779:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785994496 00000100:00100000:1.0:1783135557.175781:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785994496 00000100:00100000:1.0:1783135557.175794:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 300 00000100:00100000:1.0:1783135557.175802:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785994368:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135557.175873:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785994368:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 72us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135557.175887:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 300 00000100:00100000:1.0:1783135557.175902:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 301 00000100:00100000:1.0:1783135557.175908:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785994624:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135557.175931:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785994624:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 23us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135557.175935:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 301 00000100:00100000:1.0:1783135557.175945:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 302 00000100:00100000:1.0:1783135557.175950:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785994240:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135557.175968:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785994240:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 18us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135557.175973:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 302 00000100:00100000:1.0:1783135557.175981:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 303 00000100:00100000:1.0:1783135557.175986:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785994496:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135557.176003:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785994496:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 17us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135557.176007:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 303 00000100:00080000:2.0:1783135557.176321:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135557.176326:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135557.176384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785994112 00000100:00100000:3.0:1783135557.176390:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785994112 00000100:00100000:3.0:1783135557.176431:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 385 00000100:00100000:3.0:1783135557.176439:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785994112:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135557.176540:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785994112:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 101us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135557.176547:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 385 00010000:00010000:2.0:1783135557.487623:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135557.998374:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809160064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135557.998455:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135557.998536:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809160064 00000100:00100000:1.0:1783135557.998543:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809160064 00000100:00100000:1.0:1783135557.998598:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1783135557.998609:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809160064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135557.998642:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135557.998698:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809160064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135557.998705:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00080000:1.0:1783135557.998746:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b9aa00 x1869752809160064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135557.998766:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809160064:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783135557.999006:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135557.999072:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6750d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809160192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135557.999266:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135557.999300:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6750d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809160320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135557.999326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135557.999359:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809160192 00000100:00100000:2.0:1783135557.999363:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809160192 00000100:00100000:2.0:1783135557.999396:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783135557.999405:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809160192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135557.999431:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1783135557.999470:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809160192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135557.999477:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783135557.999497:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809160320 00000100:00100000:2.0:1783135557.999501:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809160320 00000100:00100000:2.0:1783135557.999530:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783135557.999536:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809160320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135557.999550:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135557.999579:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809160320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135557.999599:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1783135557.999617:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783135557.999639:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6750d5f80 x1869752809160320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135573 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135557.999654:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6750d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809160320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135557.999751:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6750d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809160448:0@lo:400:kworker.0 00000100:00100000:1.0:1783135558.000213:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6750d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809160576:0@lo:400:kworker.0 00000001:00100000:3.0:1783135558.009242:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000020:00000080:3.0:1783135558.009252:0:8431:0:(genops.c:906:class_export_put()) final put ffff8ac67f838800/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000100:00100000:1.0:1783135558.009413:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135558.009530:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809161088:0@lo:400:kworker.0 00000100:00100000:1.0:1783135558.009564:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135558.009631:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809160576 00000100:00100000:3.0:1783135558.009639:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809160576 00000100:00100000:3.0:1783135558.009690:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809161088 00000100:00100000:3.0:1783135558.009693:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809161088 00000100:00100000:3.0:1783135558.009721:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1783135558.009730:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809160576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135558.009807:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809160576:12345-0@lo:400:kworker.0 Request processed in 65us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135558.009815:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1783135558.009948:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1783135558.009957:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809161088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135558.009999:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809161088:12345-0@lo:400:kworker.0 Request processed in 44us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135558.010006:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1783135558.010201:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6750d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809160832:0@lo:400:kworker.0 00000100:00100000:3.0:1783135558.010232:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135558.010258:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809161344:0@lo:400:kworker.0 00000100:00100000:3.0:1783135558.010284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135558.010306:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809161856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135558.010331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135558.010365:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6750d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809160704:0@lo:400:kworker.0 00000100:00100000:3.0:1783135558.010391:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135558.010410:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809161216:0@lo:400:kworker.0 00000100:00100000:3.0:1783135558.010432:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135558.010448:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809161728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135558.010472:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135558.010519:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6750d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809160192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135558.010551:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809160704 00000100:00100000:3.0:1783135558.010554:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809160704 00000100:00100000:3.0:1783135558.010584:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1783135558.010602:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809160704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135558.010643:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809160704:12345-0@lo:400:kworker.0 Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135558.010649:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1783135558.010668:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809161856 00000100:00100000:3.0:1783135558.010671:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809161856 00000100:00100000:3.0:1783135558.010689:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809161728 00000100:00100000:3.0:1783135558.010692:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809161728 00000100:00100000:3.0:1783135558.010704:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783135558.010709:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809161856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135558.010731:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135558.010768:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809161856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135558.010774:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783135558.010785:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783135558.010790:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809161728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135558.010798:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135558.010820:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809161728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135558.010825:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783135558.011527:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809161856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135558.011556:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6750d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809160704:0@lo:400:kworker.0 00000100:00100000:3.0:1783135558.011568:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809161728:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1783135558.014206:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67f838800/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe for lustre-OST0000 00000100:00100000:1.0:1783135558.014208:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809160832 00000100:00100000:1.0:1783135558.014223:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809160832 00000020:00000080:2.0:1783135558.014276:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67f83b800 for lustre-OST0000 00000100:00080000:2.0:1783135558.014296:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135558.014301:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135558.014359:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135558.014473:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783135558.014484:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809160832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135558.014555:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809160832:12345-0@lo:400:kworker.0 Request processed in 73us (4321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135558.014562:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783135558.014587:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809161344 00000100:00100000:1.0:1783135558.014591:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809161344 00000100:00100000:1.0:1783135558.014616:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809161216 00000100:00100000:1.0:1783135558.014620:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809161216 00000100:00100000:1.0:1783135558.014635:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783135558.014641:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6752d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809161344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135558.014672:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6752d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809161344:12345-0@lo:400:kworker.0 Request processed in 31us (4387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135558.014678:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783135558.014990:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783135558.014998:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809161216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135558.015974:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809160448 00000100:00100000:2.0:1783135558.015986:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809160448 00000100:00100000:2.0:1783135558.016044:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1783135558.016054:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809160448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135558.021233:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809160960:0@lo:400:kworker.0 00000100:00100000:2.0:1783135558.026123:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809160448:12345-0@lo:400:kworker.0 Request processed in 10060us (11755us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135558.026139:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1783135558.028391:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809161216:12345-0@lo:400:kworker.0 Request processed in 13253us (17818us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135558.028409:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783135558.028516:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6750d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809160832:0@lo:400:kworker.0 00000100:00100000:1.0:1783135558.028532:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809161344:0@lo:400:kworker.0 00000100:00100000:1.0:1783135558.028576:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809161216:0@lo:400:kworker.0 00010000:00080000:1.0:1783135558.028609:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac652aeaa00 x1869752809161088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135558.028621:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809161088:0@lo:400:kworker.0 00000100:00100000:1.0:1783135558.028633:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809161600:0@lo:400:kworker.0 00000100:00100000:1.0:1783135558.028706:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135558.028762:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6750d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809160576:0@lo:400:kworker.0 00000100:00100000:2.0:1783135558.028857:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809161600 00000100:00100000:2.0:1783135558.028865:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809161600 00000100:00100000:2.0:1783135558.028954:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1783135558.028965:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809161600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135558.029030:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809161600:12345-0@lo:400:kworker.0 Request processed in 68us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135558.029037:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:2.0:1783135558.029073:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783135558.029509:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac652ae9880 x1869752809161600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135558.029522:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809161600:0@lo:400:kworker.0 00000100:00100000:2.0:1783135558.033270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135558.033332:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809161472:0@lo:400:kworker.0 00000100:00100000:2.0:1783135558.033383:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135558.033415:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809160960 00000100:00100000:2.0:1783135558.033424:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809160960 00000100:00100000:2.0:1783135558.033489:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809161472 00000100:00100000:2.0:1783135558.033493:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809161472 00000100:00100000:2.0:1783135558.033520:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1783135558.033529:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809160960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135558.033592:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809160960:12345-0@lo:400:kworker.0 Request processed in 62us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135558.033593:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1783135558.033606:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1783135558.033611:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809161472:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783135558.033637:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135558.033660:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809161472:12345-0@lo:400:kworker.0 Request processed in 54us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135558.033668:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1783135558.033681:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809161472:0@lo:400:kworker.0 00000100:00100000:2.0:1783135558.033715:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6750d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809160448:0@lo:400:kworker.0 00000100:00100000:2.0:1783135558.033725:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809160960:0@lo:400:kworker.0 00000040:00080000:2.0:1783135558.254921:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783135558.343357:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135558.513078:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135559.535782:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135560.558306:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135561.072516:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135561.072550:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809161984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135561.072663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135561.072763:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809161984 00000100:00100000:0.0:1783135561.072774:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809161984 00000100:00100000:0.0:1783135561.072843:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783135561.072854:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809161984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135561.072931:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135561.072986:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809161984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135561.073012:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783135561.073240:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809161984:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135561.583002:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135562.297471:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135562.297512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135562.297540:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135562.297562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135562.297586:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135562.297615:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785994880 00000100:00100000:3.0:1783135562.297625:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785994880 00000100:00100000:3.0:1783135562.297679:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785995136 00000100:00100000:3.0:1783135562.297744:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785995136 00000100:00100000:3.0:1783135562.297764:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785995008 00000100:00100000:3.0:1783135562.297767:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785995008 00000100:00100000:3.0:1783135562.297779:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785995264 00000100:00100000:3.0:1783135562.297780:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785995264 00000100:00100000:3.0:1783135562.297798:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 310 00000100:00100000:3.0:1783135562.297808:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785994880:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135562.297904:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785994880:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 96us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135562.297913:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 310 00000100:00100000:3.0:1783135562.297931:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 311 00000100:00100000:3.0:1783135562.297938:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785995136:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135562.298287:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 312 00000100:00100000:1.0:1783135562.298298:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785995008:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135562.298345:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785995008:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 50us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135562.298351:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 312 00000100:00100000:1.0:1783135562.298365:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 313 00000100:00100000:1.0:1783135562.298371:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785995264:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135562.298395:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785995264:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135562.298400:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 313 00000100:00100000:3.0:1783135562.298547:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785995136:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 608us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135562.298554:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 311 00000100:00100000:3.0:1783135562.298576:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785994752 00000100:00100000:3.0:1783135562.298580:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785994752 00000100:00100000:3.0:1783135562.298616:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 387 00000100:00100000:3.0:1783135562.298622:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785994752:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135562.298661:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785994752:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 40us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135562.298667:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 387 00000100:00080000:3.0:1783135562.299845:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135562.299853:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783135562.616808:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135563.118330:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809162112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135563.118355:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809162240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135563.118415:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135563.118446:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809162112 00000100:00100000:3.0:1783135563.118454:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809162112 00000100:00080000:1.0:1783135563.118511:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135563.118522:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783135563.118534:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809162112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135563.118564:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135563.118619:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809162112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135563.118626:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783135563.118654:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135563.118693:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809162112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135563.119251:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809162240 00000100:00100000:2.0:1783135563.119255:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809162240 00000100:00100000:2.0:1783135563.119287:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783135563.119295:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809162240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135563.119314:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135563.119355:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809162240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135563.119362:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783135563.119517:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809162368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135563.119553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135563.119602:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135563.119610:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809162496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135563.119636:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135563.119666:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809162496 00000100:00100000:1.0:1783135563.119749:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809162496 00000100:00100000:1.0:1783135563.119783:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783135563.119790:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809162496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783135563.119815:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783135563.119860:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809162496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135563.119866:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783135563.119888:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809162368 00000100:00100000:1.0:1783135563.119892:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809162368 00000100:00100000:1.0:1783135563.119913:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1783135563.119919:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809162368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135563.119931:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135563.119957:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809162368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135563.119963:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1783135563.119977:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135563.119981:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135563.120015:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809162496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135563.120030:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809162368:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1783135563.120183:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b98e00 x1869752809162240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135563.120200:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809162240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135563.120213:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135563.120219:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809162624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135563.120245:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135563.120290:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809162624 00000100:00100000:3.0:1783135563.120294:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809162624 00000100:00100000:3.0:1783135563.120320:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783135563.120327:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809162624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135563.120348:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135563.120380:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809162624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135563.120386:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1783135563.120401:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783135563.120416:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac652ae9180 x1869752809162624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135563.120427:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809162624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135563.121330:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809163008:0@lo:400:kworker.0 00000100:00100000:0.0:1783135563.121376:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135563.121398:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809163520:0@lo:400:kworker.0 00000100:00100000:0.0:1783135563.121419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135563.121439:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783135563.121445:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809162880:0@lo:400:kworker.0 00000100:00100000:0.0:1783135563.121466:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135563.121483:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809163392:0@lo:400:kworker.0 00000100:00100000:0.0:1783135563.121504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135563.121529:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809163008 00000100:00100000:0.0:1783135563.121535:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809163008 00000100:00100000:0.0:1783135563.121610:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809163520 00000100:00100000:0.0:1783135563.121613:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809163520 00000100:00100000:0.0:1783135563.121632:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809162880 00000100:00100000:0.0:1783135563.121634:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809162880 00000100:00100000:0.0:1783135563.121645:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809163392 00000100:00100000:0.0:1783135563.121647:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809163392 00000100:00100000:0.0:1783135563.121663:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1783135563.121827:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1783135563.121838:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809163520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135563.121900:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809163520:12345-0@lo:400:kworker.0 Request processed in 64us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135563.121907:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1783135563.121923:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1783135563.121929:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809162880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135563.121956:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809162880:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135563.121962:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1783135563.121987:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1783135563.121993:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809163392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135563.122033:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809163392:12345-0@lo:400:kworker.0 Request processed in 40us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135563.122370:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809162880:0@lo:400:kworker.0 00010000:00080000:2.0:1783135563.122384:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a3ed80 x1869752809163392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135563.122394:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809163392:0@lo:400:kworker.0 00000100:00100000:2.0:1783135563.122403:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809163520:0@lo:400:kworker.0 00000100:00100000:2.0:1783135563.122429:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809163136:0@lo:400:kworker.0 00000100:00100000:2.0:1783135563.122462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135563.122484:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809163648:0@lo:400:kworker.0 00000100:00100000:2.0:1783135563.122506:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135563.122523:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783135563.122528:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809162752:0@lo:400:kworker.0 00000100:00100000:2.0:1783135563.122550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135563.122574:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809163264:0@lo:400:kworker.0 00000100:00100000:2.0:1783135563.122595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135563.122618:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809162752 00000100:00100000:2.0:1783135563.122622:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809162752 00000100:00100000:2.0:1783135563.122652:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1783135563.122658:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809162752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135563.122856:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809163008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135563.122914:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809163008:12345-0@lo:400:kworker.0 Request processed in 1244us (1538us total) trans 0 rc 0/0 00000100:00080000:3.0:1783135563.122984:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135563.122990:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135563.123024:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809163648 00000100:00100000:3.0:1783135563.123028:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809163648 00000100:00100000:1.0:1783135563.123097:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1783135563.123115:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809163264 00000100:00100000:1.0:1783135563.123118:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809163264 00000100:00100000:0.0:1783135563.123164:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1783135563.123198:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809163136 00000100:00100000:0.0:1783135563.123281:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809163136 00000100:00100000:0.0:1783135563.123308:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783135563.123314:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809163136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135563.123353:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809163136:12345-0@lo:400:kworker.0 Request processed in 39us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135563.123360:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783135563.123439:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809163008:0@lo:400:kworker.0 00000100:00100000:0.0:1783135563.123469:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809163136:0@lo:400:kworker.0 00000100:00100000:2.0:1783135563.123655:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809162752:12345-0@lo:400:kworker.0 Request processed in 995us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135563.123661:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:2.0:1783135563.123706:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135563.123710:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135563.127666:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809162752:0@lo:400:kworker.0 00000100:00100000:3.0:1783135563.132388:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1783135563.132415:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809163648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135563.132525:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809163648:12345-0@lo:400:kworker.0 Request processed in 125us (10017us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135563.132534:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00080000:0.0:1783135563.133369:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac6434f4e00 x1869752809163648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135563.133387:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809163648:0@lo:400:kworker.0 00000100:00100000:1.0:1783135563.136481:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1783135563.136511:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809163264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135563.136835:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809163264:12345-0@lo:400:kworker.0 Request processed in 341us (14237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135563.136844:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1783135563.142888:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809163264:0@lo:400:kworker.0 00010000:00010000:3.0:1783135563.630272:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135564.485341:0:14079:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:26:03 (1783135563) 00010000:00010000:3.0:1783135564.654332:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135565.678748:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135566.190735:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135566.190762:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809163776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135566.190884:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135566.191132:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809163776 00000100:00100000:1.0:1783135566.191142:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809163776 00000100:00100000:1.0:1783135566.191193:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783135566.191202:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809163776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135566.191235:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135566.197998:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809163776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6785us (7103us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135566.198016:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783135566.198228:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809163776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135566.228049:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135566.228608:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785995392 00000100:00100000:0.0:1783135566.228622:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785995392 00000100:00100000:0.0:1783135566.229044:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:0.0:1783135566.229060:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:11097:x1869752785995392:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135566.229119:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135566.229201:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140bf6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135566.229275:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfca2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135566.229290:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135566.229336:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135566.231340:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135566.231352:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135566.231912:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135566.231967:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfc9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bf6 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135566.231994:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfca2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bf6 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135566.232003:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cde00) 00010000:00010000:0.0:1783135566.232006:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135566.232010:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989800, rc 0) 00000100:00100000:0.0:1783135566.232127:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:11097:x1869752785995392:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 3071us (4091us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135566.232136:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00080000:2.0:1783135566.232520:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135566.249003:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135566.249168:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785995520 00000100:00100000:2.0:1783135566.249179:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785995520 00000100:00100000:2.0:1783135566.249246:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:2.0:1783135566.249256:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:11098:x1869752785995520:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135566.249297:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135566.249582:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140bfd expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249651:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249667:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249679:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249693:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfcb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249700:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249726:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249847:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20ee00/0xf7de4ef628edfcbe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249855:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20ee00/0xf7de4ef628edfcbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249863:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20ee00/0xf7de4ef628edfcbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135566.249908:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135566.249911:0:13464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135566.249934:0:13464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20ee00/0xf7de4ef628edfcbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249956:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249963:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.249969:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250048:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135566.250053:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250061:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250081:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cde00) 00010000:00010000:2.0:1783135566.250084:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135566.250153:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250161:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250177:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250183:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfcb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250189:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250195:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135566.250198:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250205:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250212:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ac672e7a200) 00010000:00010000:2.0:1783135566.250214:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135566.250217:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfcb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250223:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfcb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250660:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bfd expref: 8 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250683:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20ee00/0xf7de4ef628edfcbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bfd expref: 7 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.250690:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ac672e7a000) 00010000:00010000:2.0:1783135566.250692:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135566.250695:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20ee00, rc 0) 00000100:00100000:2.0:1783135566.250771:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:11098:x1869752785995520:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1515us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135566.250780:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:3.0:1783135566.270524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135566.270709:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785995648 00000100:00100000:1.0:1783135566.270721:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785995648 00000100:00100000:1.0:1783135566.270784:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:1.0:1783135566.270804:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:11098:x1869752785995648:12345-192.168.204.6@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783135566.270900:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:11098:x1869752785995648:12345-192.168.204.6@tcp:900:lhsmtool_posix.0 Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135566.270926:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:1.0:1783135566.278324:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135566.278496:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785995904 00000100:00100000:2.0:1783135566.278506:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785995904 00000100:00100000:2.0:1783135566.278564:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:2.0:1783135566.278574:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:11098:x1869752785995904:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135566.278597:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135566.278619:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfcc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c04 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.278699:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfccc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.278714:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfccc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.278725:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfccc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.278827:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcd3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.278836:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.278844:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.278980:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628edfcda lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.278990:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628edfcda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.278997:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628edfcda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135566.279008:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1783135566.279250:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfccc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279258:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfccc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279265:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfccc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279271:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135566.279276:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfccc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279487:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfccc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279500:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ac672e7a000) 00010000:00010000:2.0:1783135566.279503:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135566.279508:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfccc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279514:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfccc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279529:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279535:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcd3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279541:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279545:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135566.279547:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279552:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcd3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279559:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ac672e7a200) 00010000:00010000:2.0:1783135566.279561:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135566.279563:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcd3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279578:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfcd3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279856:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfcc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c04 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279872:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628edfcda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c04 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135566.279878:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:2.0:1783135566.279881:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135566.279883:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e400, rc 0) 00000100:00100000:2.0:1783135566.280145:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:11098:x1869752785995904:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1570us (1842us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1783135566.280156:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:3.0:1783135566.293777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135566.294138:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785996032 00000100:00100000:0.0:1783135566.294149:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785996032 00000100:00100000:0.0:1783135566.294226:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:0.0:1783135566.294238:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:11098:x1869752785996032:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783135566.294465:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:11098:x1869752785996032:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 Request processed in 229us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135566.294473:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:0.0:1783135566.306194:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135566.312804:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785996160 00000100:00100000:2.0:1783135566.312830:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785996160 00000100:00100000:2.0:1783135566.312951:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:2.0:1783135566.312967:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:11098:x1869752785996160:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1783135566.313696:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1783135566.318217:0:13464:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5192us 00000100:00100000:1.0:1783135566.359274:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:11098:x1869752785996160:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 Request processed in 46301us (53077us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135566.359300:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 44 00000040:00080000:0.0:1783135566.456918:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1783135566.577433:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135566.708847:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135567.426826:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135567.426875:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135567.426911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135567.426963:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135567.426992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135567.427026:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785996544 00000100:00100000:1.0:1783135567.427037:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785996544 00000100:00100000:1.0:1783135567.427127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785996800 00000100:00100000:1.0:1783135567.427131:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785996800 00000100:00100000:1.0:1783135567.427159:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785996416 00000100:00100000:1.0:1783135567.427162:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785996416 00000100:00100000:1.0:1783135567.427189:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785996672 00000100:00100000:1.0:1783135567.427192:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785996672 00000100:00100000:1.0:1783135567.427211:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 320 00000100:00100000:1.0:1783135567.427222:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785996544:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135567.427314:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2399:x1869752785996544:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 93us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135567.427322:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 320 00000100:00100000:1.0:1783135567.427341:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 321 00000100:00100000:1.0:1783135567.427346:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785996800:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135567.427370:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785996800:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135567.427386:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 321 00000100:00100000:1.0:1783135567.427398:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 322 00000100:00100000:1.0:1783135567.427403:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2399:x1869752785996416:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135567.427432:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2399:x1869752785996416:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135567.427438:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 322 00000100:00100000:1.0:1783135567.427448:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 323 00000100:00100000:1.0:1783135567.427454:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785996672:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135567.427476:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2399:x1869752785996672:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 23us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135567.427482:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 323 00000100:00080000:1.0:1783135567.427511:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135567.427515:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135567.428126:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785996288 00000100:00100000:3.0:1783135567.428141:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785996288 00000100:00100000:3.0:1783135567.428191:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 389 00000100:00100000:3.0:1783135567.428200:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785996288:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135567.428249:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2399:x1869752785996288:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 51us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135567.428256:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 389 00010000:00010000:0.0:1783135567.729376:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135568.238664:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809163904:0@lo:400:kworker.0 00000100:00100000:1.0:1783135568.238672:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809164160:0@lo:400:kworker.0 00000100:00100000:1.0:1783135568.238753:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.238753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135568.238822:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809163904 00000100:00100000:2.0:1783135568.238830:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809163904 00000100:00100000:2.0:1783135568.238877:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1783135568.238885:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809163904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135568.238945:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809163904:12345-0@lo:400:kworker.0 Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135568.238961:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1783135568.239120:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809163904:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239129:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809164416:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239158:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.239179:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809164928:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239206:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.239223:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809165440:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239247:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.239279:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809165952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135568.239354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.239376:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [1->0] 00000100:00100000:0.0:1783135568.239384:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809164032:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.239423:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809164672:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.239454:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809165056:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.239486:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809165568:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239503:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.239524:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809166080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135568.239546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.239578:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809164160 00000100:00100000:0.0:1783135568.239582:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809164160 00000100:00100000:0.0:1783135568.239610:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809164416 00000100:00100000:0.0:1783135568.239613:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809164416 00000100:00100000:0.0:1783135568.239628:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783135568.239635:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809164160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239670:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809164160:12345-0@lo:400:kworker.0 Request processed in 36us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.239676:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783135568.239688:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783135568.239693:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809164416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239717:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809164416:12345-0@lo:400:kworker.0 Request processed in 24us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.239722:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783135568.239736:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809164928 00000100:00100000:0.0:1783135568.239738:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809164928 00000100:00100000:0.0:1783135568.239759:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809165440 00000100:00100000:0.0:1783135568.239762:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809165440 00000100:00100000:0.0:1783135568.239771:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809165056 00000100:00100000:0.0:1783135568.239773:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809165056 00000100:00100000:0.0:1783135568.239782:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809165568 00000100:00100000:0.0:1783135568.239784:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809165568 00000100:00100000:0.0:1783135568.239794:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783135568.239799:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809164928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239843:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809164928:12345-0@lo:400:kworker.0 Request processed in 43us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.239857:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783135568.239867:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783135568.239872:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809165440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239894:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809165440:12345-0@lo:400:kworker.0 Request processed in 23us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.239911:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783135568.239922:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783135568.239927:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809165056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239952:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809165056:12345-0@lo:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.239957:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783135568.239966:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783135568.239971:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809165568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.239995:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809165568:12345-0@lo:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.240000:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783135568.240019:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809165952 00000100:00100000:0.0:1783135568.240023:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809165952 00000100:00100000:0.0:1783135568.240044:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809166080 00000100:00100000:0.0:1783135568.240046:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809166080 00000100:00100000:0.0:1783135568.240057:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783135568.240063:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809165952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135568.240083:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135568.240138:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809165952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.240153:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1783135568.240164:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783135568.240169:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809166080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135568.240179:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135568.240198:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809166080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.240203:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783135568.240219:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809164032 00000100:00100000:0.0:1783135568.240222:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809164032 00000100:00100000:0.0:1783135568.240244:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809164672 00000100:00100000:0.0:1783135568.240247:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809164672 00000100:00100000:0.0:1783135568.240265:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1783135568.240270:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809164032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.240297:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809164032:12345-0@lo:400:kworker.0 Request processed in 27us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.240303:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1783135568.240313:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1783135568.240318:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809164672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.240339:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809164672:12345-0@lo:400:kworker.0 Request processed in 22us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.240345:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00080000:0.0:1783135568.240373:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135568.240378:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135568.240380:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135568.240410:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809164032:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.240419:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809164672:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.240434:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809165056:0@lo:400:kworker.0 00010000:00080000:0.0:1783135568.240445:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3ca80 x1869752809165568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135568.240455:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809165568:0@lo:400:kworker.0 00010000:00080000:0.0:1783135568.240464:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a5b100 x1869752809166080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135568.240477:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809166080:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1783135568.240485:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac652aeaa00 x1869752809165952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135568.240494:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809165952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135568.240503:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809164416:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.240511:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809164928:0@lo:400:kworker.0 00010000:00080000:0.0:1783135568.240518:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3c380 x1869752809165440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135568.240525:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809165440:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.241541:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b59b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809164288:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.241595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.241633:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809164800:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.241651:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.241666:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809165312:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.241682:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.241717:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809165824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135568.241739:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135568.241771:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809164288 00000100:00100000:0.0:1783135568.241776:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809164288 00000100:00100000:0.0:1783135568.241808:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809164800 00000100:00100000:0.0:1783135568.241811:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809164800 00000100:00100000:0.0:1783135568.241831:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809165312 00000100:00100000:0.0:1783135568.241833:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809165312 00000100:00100000:0.0:1783135568.241846:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783135568.241853:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809164288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.241920:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809164288:12345-0@lo:400:kworker.0 Request processed in 66us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.241926:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1783135568.241941:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783135568.241947:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809164800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.241973:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809164800:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.241978:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1783135568.241989:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1783135568.241995:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809165312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.242023:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809165312:12345-0@lo:400:kworker.0 Request processed in 29us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.242028:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00080000:0.0:1783135568.242050:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135568.242062:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809165824 00000100:00100000:0.0:1783135568.242065:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809165824 00000100:00100000:0.0:1783135568.242108:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783135568.242115:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809165824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135568.242144:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135568.242178:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809165824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135568.242184:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783135568.242221:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b59b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809164288:0@lo:400:kworker.0 00010000:00080000:0.0:1783135568.242233:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac66b599880 x1869752809164800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135568.242243:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809164800:0@lo:400:kworker.0 00010000:00080000:0.0:1783135568.242252:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b3f480 x1869752809165312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135568.242260:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809165312:0@lo:400:kworker.0 00000100:00100000:0.0:1783135568.242274:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809165824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135568.245030:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809164160:0@lo:400:kworker.0 00000100:00100000:1.0:1783135568.245048:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809164544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135568.245127:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135568.245163:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809165184:0@lo:400:kworker.0 00000100:00100000:1.0:1783135568.245511:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135568.245538:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809165696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135568.245640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135568.245977:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809164544 00000100:00100000:2.0:1783135568.245984:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809164544 00000100:00100000:2.0:1783135568.246034:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783135568.246043:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809164544:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135568.246057:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809165696 00000100:00100000:1.0:1783135568.246073:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809165696 00000004:00000024:2.0:1783135568.246102:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1783135568.246126:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783135568.246134:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809165696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135568.246152:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135568.246162:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809164544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135568.246172:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783135568.246788:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809165696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 653us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135568.246797:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783135568.246824:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809165184 00000100:00100000:1.0:1783135568.246828:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809165184 00000100:00100000:1.0:1783135568.247077:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1783135568.247115:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809165184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135568.247166:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809165184:12345-0@lo:400:kworker.0 Request processed in 82us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135568.247173:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1783135568.247234:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809164544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135568.247248:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809165184:0@lo:400:kworker.0 00000100:00100000:1.0:1783135568.247262:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809165696:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783135568.248045:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1783135568.494990:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1783135568.622866:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135568.752817:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135568.967723:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135568.967778:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785996928 00000100:00100000:3.0:1783135568.967788:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785996928 00000100:00100000:3.0:1783135568.967864:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:3.0:1783135568.967875:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:11140:x1869752785996928:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135568.968190:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135568.968214:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfce8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c0b expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968283:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfcef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968299:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfcef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968312:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfcef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968328:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfcf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968336:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968356:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968405:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfcef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968412:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfcef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968420:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfcef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968425:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135568.968430:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfcef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968436:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfcef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968447:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cde00) 00010000:00010000:3.0:1783135568.968450:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135568.968454:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfcef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968460:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfcef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968471:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968477:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfcf6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968489:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968494:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135568.968497:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968503:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfcf6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968510:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ac67c491700) 00010000:00010000:3.0:1783135568.968512:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135568.968515:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfcf6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968520:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfcf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968553:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfce8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c0b expref: 10 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968563:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cde00) 00010000:00010000:3.0:1783135568.968566:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135568.968569:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfce8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c0b expref: 10 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135568.968579:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526400, rc 0) 00000100:00100000:3.0:1783135568.968657:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:11140:x1869752785996928:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 784us (943us total) trans 0 rc 301/301 00000100:00100000:3.0:1783135568.968674:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00080000:2.0:1783135568.969437:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135568.990059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.000188:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785997184 00000100:00100000:0.0:1783135569.000203:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785997184 00000100:00100000:0.0:1783135569.000273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:0.0:1783135569.000285:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:11140:x1869752785997184:12345-192.168.204.6@tcp:36:lfs.0 00010000:00010000:0.0:1783135569.000351:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135569.000379:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfca2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bf6 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.000401:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cde00) 00010000:00010000:0.0:1783135569.000411:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135569.000490:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfcfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.000505:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.000516:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.000530:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.000538:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.000545:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002445:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002470:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002482:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135569.002499:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efba0a75 reply state 000000009383feeb transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002512:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002520:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135569.002533:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135569.002537:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783135569.002544:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783135569.002553:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002560:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfcfd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002567:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfcfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002574:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135569.002579:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfcfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002586:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfcfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002596:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:0.0:1783135569.002599:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135569.002602:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfcfd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002608:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfcfd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135569.002629:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efba0a75 reply state 000000009383feeb transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002638:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.002656:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ac5424cdb00) 00010000:00010000:0.0:1783135569.002658:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135569.002660:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1783135569.003967:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:11140:x1869752785997184:12345-192.168.204.6@tcp:36:lfs.0 Request processed in 3676us (13914us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783135569.003979:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:3.0:1783135569.127854:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.128154:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785997312 00000100:00100000:0.0:1783135569.128163:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785997312 00000100:00100000:0.0:1783135569.128225:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:0.0:1783135569.128235:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:11148:x1869752785997312:12345-192.168.204.6@tcp:101:lctl.0 00010000:00010000:0.0:1783135569.128265:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135569.128292:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfd12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c12 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.128375:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfd19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.128389:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfd19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.128402:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfd19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135569.128449:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135569.128453:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135569.128492:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfd19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.128517:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfd12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c12 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.128551:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfd19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c12 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.128560:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:0.0:1783135569.128564:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135569.128567:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989800, rc 0) 00000100:00100000:0.0:1783135569.128636:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:11148:x1869752785997312:12345-192.168.204.6@tcp:101:lctl.0 Request processed in 402us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135569.128644:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:2.0:1783135569.204037:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135569.204181:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785997440 00000100:00100000:3.0:1783135569.204192:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785997440 00000100:00100000:3.0:1783135569.204260:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:3.0:1783135569.204275:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:11154:x1869752785997440:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1783135569.204301:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135569.204324:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfd20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c19 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204396:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfd27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204412:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfd27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204423:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfd27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204434:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfd2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204442:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfd2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204448:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfd2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204540:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfd35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204568:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfd35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204576:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfd35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135569.204632:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1783135569.204637:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135569.204674:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfd35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204687:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfd27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204694:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfd27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204700:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfd27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204706:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135569.204710:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfd27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204717:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfd27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204730:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:3.0:1783135569.204734:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135569.204738:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfd27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204755:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfd27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204769:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfd2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204775:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfd2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204781:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfd2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204785:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135569.204788:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfd2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204795:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfd2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204802:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ac5424cdb00) 00010000:00010000:3.0:1783135569.204805:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135569.204808:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfd2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204813:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfd2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204846:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfd20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c19 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204859:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfd35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c19 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.204872:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:3.0:1783135569.204875:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783135569.204877:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527e00, rc 0) 00000100:00100000:3.0:1783135569.205274:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:11154:x1869752785997440:12345-192.168.204.6@tcp:101:bash.0 Request processed in 1001us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135569.205282:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:2.0:1783135569.214175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.214385:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785997696 00000100:00100000:0.0:1783135569.214395:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785997696 00000100:00100000:0.0:1783135569.214481:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:0.0:1783135569.214492:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:11154:x1869752785997696:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1783135569.214513:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135569.214533:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfd3c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c20 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.214637:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfd43 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.214652:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfd43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.214665:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfd43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.214679:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.214698:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.214706:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135569.215226:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1783135569.215439:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215448:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215457:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215492:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfd43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215499:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfd43 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215506:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfd43 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215513:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135569.215517:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfd43 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215524:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfd43 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215547:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135569.215550:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135569.215555:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfd43 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215561:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628edfd43 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135569.215577:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061f5cd79 reply state 000000005b5cf33f transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215589:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215595:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424cde00) 00010000:00010000:0.0:1783135569.215597:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135569.215600:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783135569.215633:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628edfd3c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c20 expref: 15 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215650:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c20 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.215656:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac5424cd600) 00010000:00010000:0.0:1783135569.215658:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135569.215660:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65cc00, rc 0) 00000100:00100000:0.0:1783135569.215955:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:11154:x1869752785997696:12345-192.168.204.6@tcp:101:bash.0 Request processed in 1462us (1869us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1783135569.215964:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:1.0:1783135569.220445:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.220534:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785997824 00000100:00100000:0.0:1783135569.220544:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785997824 00000100:00100000:0.0:1783135569.220626:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:0.0:1783135569.220635:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1869752785997824:12345-192.168.204.6@tcp:8:bash.0 00010000:00080000:0.0:1783135569.220681:0:8438:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:0.0:1783135569.220712:0:8438:0:(genops.c:1406:class_connect()) connect: client 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe, cookie 0xf7de4ef628edfd5f 00002000:00100000:0.0:1783135569.220726:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe/ffff8ac543a8e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135569.220740:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135569.220904:0:8438:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783135569.220994:0:8438:0:(import.c:65:import_set_state_nolock()) ffff8ac543a8b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135569.221190:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2397:x1869752785997824:12345-192.168.204.6@tcp:8:bash.0 Request processed in 553us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135569.221199:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:2.0:1783135569.223565:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.223695:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785997952 00000100:00100000:0.0:1783135569.223707:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785997952 00000100:00100000:0.0:1783135569.223826:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:0.0:1783135569.223836:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:0:x1869752785997952:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1783135569.223854:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135569.223896:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628edfd66 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c27 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135569.223941:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135569.223967:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1783135569.223971:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135569.223983:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628edfd66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c27 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.224030:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628edfd66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c27 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.224047:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65ca00, rc 0) 00000100:00100000:0.0:1783135569.224137:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:0:x1869752785997952:12345-192.168.204.6@tcp:101:bash.0 Request processed in 303us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135569.224145:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00080000:2.0:1783135569.224196:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135569.229000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135569.229280:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785998080 00000100:00100000:1.0:1783135569.229292:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785998080 00000100:00100000:0.0:1783135569.229464:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:0.0:1783135569.229477:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:11154:x1869752785998080:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1783135569.229499:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135569.229521:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c2e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.229553:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628edfd66 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c27 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.229562:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135569.229566:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135569.229572:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.229610:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628edfd66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c27 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.229647:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628edfd66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c27 expref: 8 pid: 8438 timeout: 573 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135569.229662:0:8437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1869752809166208:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135569.230784:0:8437:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543af5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135569.234251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135569.234497:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785998208 00000100:00100000:1.0:1783135569.234507:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785998208 00000100:00100000:2.0:1783135569.234533:0:8437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac66b599880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1869752809166208:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135569.234546:0:10345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628edfd66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c27 expref: 9 pid: 8438 timeout: 573 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.234561:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135569.234587:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:1.0:1783135569.234614:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac64887e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2400:x1869752785998208:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135569.234647:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d200, rc 0) 00010000:00010000:1.0:1783135569.234710:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135569.234733:0:10345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628edfd66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c27 expref: 9 pid: 8438 timeout: 573 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.234745:0:10345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628edfd66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c27 expref: 9 pid: 8438 timeout: 573 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135569.234778:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:11154:x1869752785998080:12345-192.168.204.6@tcp:101:bash.0 Request processed in 5304us (5861us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135569.234785:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 30 00010000:00010000:1.0:1783135569.235559:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628edfd66 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c27 expref: 8 pid: 8438 timeout: 573 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.235582:0:10345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135569.235586:0:10345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135569.235595:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.235606:0:10345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.235658:0:10345:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135569.235673:0:10345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10345:1869752809166336:192.168.204.6@tcp:105: 00000100:00100000:1.0:1783135569.235738:0:10345:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac641254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135569.238391:0:10345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10345:1869752809166336:192.168.204.6@tcp:105: 00010000:00010000:1.0:1783135569.238434:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135569.238491:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac64887e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752785998208:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 3878us (4250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135569.238502:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:2.0:1783135569.241975:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135569.242068:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785998464 00000100:00100000:3.0:1783135569.242079:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785998464 00000100:00100000:3.0:1783135569.242179:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:3.0:1783135569.242191:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:11154:x1869752785998464:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:3.0:1783135569.242542:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11154:x1869752785998464:12345-192.168.204.6@tcp:35:bash.0 Request processed in 353us (577us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783135569.242550:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:3.0:1783135569.364671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.365313:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785998720 00000100:00100000:0.0:1783135569.365325:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785998720 00000100:00100000:0.0:1783135569.365446:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:0.0:1783135569.365457:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11164:x1869752785998720:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135569.365482:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135569.365502:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628edfd74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c35 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135569.365731:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783135569.365847:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628edfd74 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c35 expref: 18 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.365862:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:0.0:1783135569.365865:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135569.365870:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628edfd74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c35 expref: 18 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.365895:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c600, rc 0) 00000100:00100000:0.0:1783135569.365981:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11164:x1869752785998720:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 525us (1319us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1783135569.366763:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:0.0:1783135569.372160:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135569.372291:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785998976 00000100:00100000:3.0:1783135569.372301:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785998976 00000100:00100000:3.0:1783135569.372367:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:3.0:1783135569.372378:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11164:x1869752785998976:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135569.372764:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11164:x1869752785998976:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 386us (612us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783135569.372771:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:3.0:1783135569.529138:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.529300:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785999104 00000100:00100000:0.0:1783135569.529311:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785999104 00000100:00100000:0.0:1783135569.529379:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:0.0:1783135569.529390:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11170:x1869752785999104:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135569.529424:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135569.529447:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfd82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c3c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.529520:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfd89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.529535:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfd89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.529547:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfd89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135569.529590:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783135569.529594:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135569.529613:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfd89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.529646:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfd82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c3c expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.529664:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfd89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c3c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.529690:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135569.529693:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135569.529697:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d600, rc 0) 00000100:00100000:0.0:1783135569.529761:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11170:x1869752785999104:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 372us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135569.529768:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:0.0:1783135569.541019:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135569.541816:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785999360 00000100:00100000:2.0:1783135569.541829:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785999360 00000100:00100000:2.0:1783135569.541906:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:2.0:1783135569.541928:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11170:x1869752785999360:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135569.541956:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135569.541982:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfd90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c43 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.542166:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfd97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.542181:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfd97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.542192:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfd97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135569.542203:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783135569.542326:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfd90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c43 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.542344:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfd97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c43 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.542353:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac5424cd600) 00010000:00010000:2.0:1783135569.542356:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135569.542360:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e000, rc 0) 00000100:00100000:2.0:1783135569.542431:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:11170:x1869752785999360:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 506us (1423us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783135569.542455:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:1.0:1783135569.559412:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135569.559593:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785999744 00000100:00100000:2.0:1783135569.559607:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785999744 00000100:00100000:2.0:1783135569.559684:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:2.0:1783135569.559696:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:2398:x1869752785999744:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135569.559713:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135569.559740:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfd97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c43 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.559759:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac5424cd600) 00010000:00010000:2.0:1783135569.559764:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135569.559829:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:2398:x1869752785999744:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 134us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135569.559837:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:3.0:1783135569.567434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.567551:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785999616 00000100:00100000:0.0:1783135569.567574:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785999616 00000100:00100000:0.0:1783135569.567648:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:0.0:1783135569.567659:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:11170:x1869752785999616:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135569.567687:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135569.567709:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfda5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c4a expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.567838:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfdac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.567856:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfdac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.567867:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfdac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135569.567892:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783135569.568014:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfda5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c4a expref: 23 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.568061:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfdac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c4a expref: 22 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.568069:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac5424cd600) 00010000:00010000:0.0:1783135569.568072:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783135569.568075:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d800, rc 0) 00000100:00100000:0.0:1783135569.568271:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11170:x1869752785999616:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 612us (846us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1783135569.568278:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:3.0:1783135569.600205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.600419:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752785999872 00000100:00100000:0.0:1783135569.600431:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752785999872 00000100:00100000:0.0:1783135569.600501:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:0.0:1783135569.600513:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752785999872:12345-192.168.204.6@tcp:1:lfs.0 00010000:00010000:0.0:1783135569.600577:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.600599:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.600608:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135569.600612:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135569.600617:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.600659:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.600683:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 7 pid: 8437 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135569.600698:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1869752809166464:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135569.600802:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543af5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135569.604457:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1869752809166464:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135569.604493:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135569.606267:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.606475:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786000000 00000100:00100000:0.0:1783135569.606484:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786000000 00002000:00100000:0.0:1783135569.606532:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8ac541d9a300 x1869752786000000/t0(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:740/0 lens 504/0 e 0 to 0 dl 1783135580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135569.606544:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac541d9a300 with x1869752786000000 ext(0->12) 00010000:00010000:0.0:1783135569.606552:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 8 pid: 8437 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.606578:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 8 pid: 8437 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135569.606587:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ac541d9a300 00000100:00100000:0.0:1783135569.606618:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:0.0:1783135569.606628:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786000000:12345-192.168.204.6@tcp:4:lfs.0 00000001:00100000:0.0:1783135569.610241:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000100:00100000:2.0:1783135569.611202:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2400:x1869752786000000:12345-192.168.204.6@tcp:4:lfs.0 Request processed in 4566us (4933us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783135569.611220:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00002000:00100000:2.0:1783135569.611231:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8ac541d9a300 x1869752786000000/t4294967300(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:740/0 lens 504/448 e 0 to 0 dl 1783135580 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135569.611241:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac541d9a300 with x1869752786000000 ext(0->12) 00010000:00010000:2.0:1783135569.611252:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 9 pid: 8437 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.611270:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 9 pid: 8437 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135569.611297:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ac541d9a300 00000100:00100000:1.0:1783135569.629426:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.629547:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786000128 00000100:00100000:0.0:1783135569.629567:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786000128 00010000:00010000:0.0:1783135569.629617:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 9 pid: 8437 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135569.629666:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:0.0:1783135569.629677:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2399:x1869752786000128:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135569.629696:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783135569.629715:0:10344:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783135569.629718:0:10344:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1783135569 00002000:00010000:0.0:1783135569.629721:0:10344:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1783135570 00002000:00010000:0.0:1783135569.629723:0:10344:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1783135569 00002000:00010000:0.0:1783135569.629725:0:10344:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783135569.629732:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 9 pid: 8437 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.629747:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 9 pid: 8437 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.629773:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003023ca19/0xf7de4ef628edfd6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c2e expref: 9 pid: 8437 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.629790:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135569.629795:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135569.629801:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.629826:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.629861:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135569.629944:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2399:x1869752786000128:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 268us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135569.629952:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 53 00010000:00010000:1.0:1783135569.630127:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.630137:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.630158:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.630166:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.630174:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.630183:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d400 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135569.630187:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.630195:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.630216:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.630224:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084a90e1/0xf7de4ef628edfdba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135569.630274:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752785999872:12345-192.168.204.6@tcp:1:lfs.0 Request processed in 29763us (30080us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135569.630283:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:3.0:1783135569.632846:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135569.632980:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786000384 00000100:00100000:2.0:1783135569.633083:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786000384 00000100:00100000:2.0:1783135569.633328:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:2.0:1783135569.633342:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11170:x1869752786000384:12345-192.168.204.6@tcp:35:lfs.0 00000004:00010000:2.0:1783135569.633409:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfdac lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c4a expref: 22 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135569.633697:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1783135569.633758:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1783135569.634143:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1783135569.634186:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.634201:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c20 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.634211:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.634251:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c20 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.634266:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c20 expref: 26 pid: 6524 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135569.634281:0:6525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6525:1869752809166592:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135569.634388:0:6525:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bceaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135569.640639:0:6525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6525:1869752809166592:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135569.640685:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135569.641681:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.650317:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786000512 00000100:00100000:0.0:1783135569.650333:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786000512 00010000:00010000:0.0:1783135569.650386:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c20 expref: 27 pid: 6524 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135569.650642:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:0.0:1783135569.650653:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:2400:x1869752786000512:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135569.650672:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135569.650679:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c20 expref: 27 pid: 6524 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.650693:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c20 expref: 27 pid: 6524 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.650715:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfd51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c20 expref: 27 pid: 6524 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.650733:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac5424cd600) 00010000:00010000:0.0:1783135569.650752:0:10346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.650762:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.650769:0:10346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.650801:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135569.650893:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+26:2400:x1869752786000512:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 225us (9204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135569.650901:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 54 00010000:00010000:3.0:1783135569.650956:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.650965:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135569.651133:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1783135569.651253:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1783135569.651343:0:6525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869752809166720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135569.651404:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135569.651451:0:6525:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072180 going to sleep for 11 seconds 00000100:00100000:3.0:1783135569.651472:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809166720 00000100:00100000:3.0:1783135569.651477:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809166720 00000100:00100000:3.0:1783135569.651506:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783135569.651512:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1869752809166720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135569.651588:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1869752809166720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135569.651594:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783135569.651635:0:6525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869752809166720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783135569.651773:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1783135569.651812:0:6525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869752809166848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135569.651837:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135569.651864:0:6525:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135569.651952:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809166848 00000100:00100000:2.0:1783135569.651957:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809166848 00000100:00100000:2.0:1783135569.651988:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783135569.651996:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1869752809166848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783135569.652117:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6525:x1869752809166848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 122us (278us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783135569.652124:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783135569.652320:0:6525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869752809166848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783135569.652439:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1783135569.652470:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.652480:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.652486:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.652492:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135569.652497:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.652503:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.652518:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac5424cd600) 00010000:00010000:3.0:1783135569.652520:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783135569.652524:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.652530:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfdc1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135569.652627:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783135569.652693:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1783135569.652705:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 473445617313ns, next at 474445614454ns, rc = 0 00000001:00080000:3.0:1783135569.652711:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:3.0:1783135569.652745:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac5424cd600) 00010000:00010000:3.0:1783135569.652748:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783135569.652754:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edfdac lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c4a expref: 30 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135569.653132:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:11170:x1869752786000384:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 19793us (20302us total) trans 4294967327 rc 0/0 00000100:00100000:3.0:1783135569.653142:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000020:00080000:3.0:1783135569.653148:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783135569.658786:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135569.658894:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786000640 00000100:00100000:3.0:1783135569.658906:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786000640 00000100:00100000:3.0:1783135569.659255:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:3.0:1783135569.659268:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:11170:x1869752786000640:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135569.659297:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135569.659320:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfdc8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c51 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.659387:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfdc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c51 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.659405:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfdc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c51 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.659438:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135569.659442:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135569.659445:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526400, rc 0) 00000100:00100000:3.0:1783135569.659524:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:11170:x1869752786000640:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 259us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135569.659549:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:2.0:1783135569.664363:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135569.665464:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786000896 00000100:00100000:1.0:1783135569.665492:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786000896 00000100:00100000:1.0:1783135569.665578:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:1.0:1783135569.665590:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6580b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:11170:x1869752786000896:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:1.0:1783135569.668378:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6580b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+31:11170:x1869752786000896:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 2769us (4011us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1783135569.668398:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00010000:00010000:1.0:1783135569.774390:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135569.779671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135569.779804:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786001152 00000100:00100000:1.0:1783135569.779818:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786001152 00000100:00100000:1.0:1783135569.779915:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:1.0:1783135569.779926:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+31:11180:x1869752786001152:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135569.779959:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135569.779987:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edfdcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c58 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135569.780212:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1783135569.780347:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edfdcf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c58 expref: 33 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.780365:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:1.0:1783135569.780369:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135569.780373:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edfdcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c58 expref: 33 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135569.780390:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b200, rc 0) 00000100:00100000:1.0:1783135569.780461:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:11180:x1869752786001152:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 537us (805us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1783135569.780469:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:2.0:1783135569.797083:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135569.797241:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786001280 00000100:00100000:3.0:1783135569.797255:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786001280 00000100:00100000:3.0:1783135569.797340:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:3.0:1783135569.797352:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:11180:x1869752786001280:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:3.0:1783135569.797591:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfddd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.797615:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfddd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.797739:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfddd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.797827:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfde4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.797839:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfde4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.797847:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfde4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.798346:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799179:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799197:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135569.799316:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799337:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfddd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799344:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfddd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799353:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfddd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799358:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135569.799363:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfddd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799372:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfddd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799389:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:3.0:1783135569.799392:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135569.799397:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfddd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799403:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628edfddd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799422:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfde4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799428:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfde4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799441:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfde4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799446:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135569.799449:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfde4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799456:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfde4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799540:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424cde00) 00010000:00010000:3.0:1783135569.799543:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135569.799547:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfde4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799553:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628edfde4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799564:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799571:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799576:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799581:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135569.799584:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799602:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799611:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135569.799613:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135569.799738:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135569.799747:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfdeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135569.800257:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:11180:x1869752786001280:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 2899us (3182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135569.800271:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:2.0:1783135569.804082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135569.804280:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786001536 00000100:00100000:3.0:1783135569.804296:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786001536 00000100:00100000:3.0:1783135569.804430:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:3.0:1783135569.804443:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:11180:x1869752786001536:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135569.805005:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+33:11180:x1869752786001536:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 560us (939us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1783135569.805015:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:0.0:1783135569.845530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135569.846123:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786001792 00000100:00100000:3.0:1783135569.846139:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786001792 00000100:00100000:2.0:1783135569.846628:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1783135569.846648:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+33:11183:x1869752786001792:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135569.846683:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135569.846714:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfdf2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c5f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847321:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfdf9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847345:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847362:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847403:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847411:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847419:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847642:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847653:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847661:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135569.847673:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783135569.847861:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847880:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfdf9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847888:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfdf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.847894:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135569.847899:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfdf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848041:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfdf9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848056:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135569.848060:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135569.848065:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfdf9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848072:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfdf9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848229:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848236:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848242:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848247:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135569.848250:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848256:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848265:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424cde00) 00010000:00010000:2.0:1783135569.848268:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135569.848271:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848287:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848347:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628edfdf2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c5f expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848364:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c5f expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135569.848372:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:2.0:1783135569.848375:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135569.848377:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e800, rc 0) 00000100:00100000:2.0:1783135569.848478:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:11183:x1869752786001792:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1837us (2963us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1783135569.848563:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1783135569.854182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135569.854292:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786001920 00000100:00100000:0.0:1783135569.854306:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786001920 00000100:00100000:0.0:1783135569.854389:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:0.0:1783135569.854404:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:11183:x1869752786001920:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:0.0:1783135569.854502:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.854524:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.854538:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.854589:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.854623:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.854631:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.854637:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65ca00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135569.854642:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.854651:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.854667:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135569.854671:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135569.854676:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135569.854682:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135569.854801:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:11183:x1869752786001920:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 400us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135569.854810:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:0.0:1783135569.858803:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135569.858927:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786002176 00000100:00100000:1.0:1783135569.858941:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786002176 00000100:00100000:1.0:1783135569.859009:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:1.0:1783135569.859020:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:11183:x1869752786002176:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:1.0:1783135569.859882:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+36:11183:x1869752786002176:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 848us (1076us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1783135569.859895:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:1.0:1783135570.263523:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135570.263672:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786002432 00000100:00100000:3.0:1783135570.263688:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786002432 00000100:00080000:2.0:1783135570.263877:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135570.264174:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:3.0:1783135570.264192:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+36:11215:x1869752786002432:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:3.0:1783135570.264255:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135570.264284:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c66 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.264436:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628edfe23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.264455:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628edfe23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.264471:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628edfe23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135570.264486:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783135570.264838:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c66 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.264879:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628edfe23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c66 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.264891:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135570.265035:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135570.265042:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030e00, rc 0) 00000100:00100000:3.0:1783135570.265226:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:11215:x1869752786002432:12345-192.168.204.6@tcp:101:cat.0 Request processed in 1040us (1720us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783135570.265236:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:2.0:1783135570.273283:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135570.273763:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786002560 00000100:00100000:0.0:1783135570.273781:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786002560 00000100:00100000:0.0:1783135570.273892:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:0.0:1783135570.273916:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:2399:x1869752786002560:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135570.273967:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135570.274004:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628edfe23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c66 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.274036:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135570.274042:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135570.274173:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:2399:x1869752786002560:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 260us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135570.274182:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:2.0:1783135570.276945:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135570.277167:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786002816 00000100:00100000:3.0:1783135570.277180:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786002816 00000100:00100000:3.0:1783135570.277264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:3.0:1783135570.277290:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:11215:x1869752786002816:12345-192.168.204.6@tcp:35:cat.0 00000100:00100000:3.0:1783135570.277825:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:11215:x1869752786002816:12345-192.168.204.6@tcp:35:cat.0 Request processed in 535us (895us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1783135570.277834:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1783135570.356511:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135570.356650:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786003072 00000100:00100000:2.0:1783135570.356666:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786003072 00000100:00100000:2.0:1783135570.356752:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:2.0:1783135570.356765:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:11221:x1869752786003072:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:2.0:1783135570.356807:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135570.356811:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783135570.356855:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628edfd89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c3c expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.356997:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135570.357005:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135570.357030:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfe31 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c6d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.357318:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.357337:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c5f expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.357348:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.357399:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c5f expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.357416:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c5f expref: 38 pid: 6523 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135570.357436:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869752809166976:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135570.357580:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bcea0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135570.360696:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869752809166976:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135570.360743:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135570.361139:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135570.362172:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786003200 00000100:00100000:3.0:1783135570.362189:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786003200 00010000:00010000:3.0:1783135570.362252:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c5f expref: 39 pid: 6523 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135570.362355:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1783135570.362367:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+39:2400:x1869752786003200:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135570.362391:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135570.362399:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c5f expref: 39 pid: 6523 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.362412:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c5f expref: 39 pid: 6523 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.362439:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628edfe07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c5f expref: 39 pid: 6523 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.362459:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135570.362465:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.362476:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.362507:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.362549:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135570.362784:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:2400:x1869752786003200:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 417us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135570.362795:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00010000:00010000:1.0:1783135570.368507:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.368533:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135570.368573:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783135570.368858:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628edfe31 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c6d expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.368914:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c6d expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.368926:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:1.0:1783135570.368930:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135570.368934:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f600, rc 0) 00000100:00100000:1.0:1783135570.369044:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:11221:x1869752786003072:12345-192.168.204.6@tcp:101:dd.0 Request processed in 12279us (12548us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1783135570.369055:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:0.0:1783135570.378187:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135570.378470:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786003328 00000100:00100000:2.0:1783135570.378483:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786003328 00000100:00100000:2.0:1783135570.378559:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:2.0:1783135570.378571:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:11221:x1869752786003328:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:2.0:1783135570.378626:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135570.378670:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edfe46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c74 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.378719:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.378737:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.378751:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.378929:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edfe46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c74 expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.378955:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c74 expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.378966:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:2.0:1783135570.378970:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135570.378977:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908000, rc 0) 00000100:00100000:2.0:1783135570.379063:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+39:11221:x1869752786003328:12345-192.168.204.6@tcp:101:dd.0 Request processed in 493us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135570.379071:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:2.0:1783135570.382630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135570.383607:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786003584 00000100:00100000:1.0:1783135570.383640:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786003584 00000100:00100000:1.0:1783135570.383742:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:1.0:1783135570.383755:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+39:11221:x1869752786003584:12345-192.168.204.6@tcp:36:dd.0 00010000:00010000:1.0:1783135570.384147:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.384172:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.384210:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135570.384267:0:8461:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1783135570.384296:0:8461:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1a20f29 reply state 000000000586896d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.384313:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.384321:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:1.0:1783135570.384324:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135570.384329:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135570.384466:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+42:11221:x1869752786003584:12345-192.168.204.6@tcp:36:dd.0 Request processed in 712us (1853us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1783135570.384476:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 62 00000020:00080000:1.0:1783135570.384483:0:8461:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783135570.694032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135570.694573:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786003712 00000100:00100000:2.0:1783135570.694588:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786003712 00000100:00100000:2.0:1783135570.694699:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:2.0:1783135570.694718:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+42:11235:x1869752786003712:12345-192.168.204.6@tcp:101:stat.0 00010000:00010000:2.0:1783135570.694778:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135570.694806:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edfe5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c7b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.694920:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edfe62 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.694939:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edfe62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.694958:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edfe62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.694972:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfe69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.694979:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfe69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.694986:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfe69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.695077:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.695124:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c6d expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.695134:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.695186:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c6d expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.695211:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c6d expref: 43 pid: 6523 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135570.695229:0:6523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869752809167104:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135570.695371:0:6523:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bceaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135570.700380:0:6523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1869752809167104:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135570.700432:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135570.705154:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135570.705374:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786003968 00000100:00100000:3.0:1783135570.705391:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786003968 00000100:00100000:3.0:1783135570.705482:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:3.0:1783135570.705494:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+44:6173:x1869752786003968:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783135570.707875:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+45:6173:x1869752786003968:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 2359us (2711us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1783135570.708193:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:2.0:1783135570.713223:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135570.713363:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786004096 00000100:00100000:1.0:1783135570.713379:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786004096 00010000:00010000:1.0:1783135570.713435:0:10345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c6d expref: 45 pid: 6523 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135570.713555:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:1.0:1783135570.713591:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+45:2401:x1869752786004096:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135570.713616:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135570.713636:0:10345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c6d expref: 45 pid: 6523 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.713654:0:10345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c6d expref: 45 pid: 6523 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.713687:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628edfe38 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c6d expref: 45 pid: 6523 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.713711:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:1.0:1783135570.713717:0:10345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.713730:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.713756:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135570.713801:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135570.713897:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+44:2401:x1869752786004096:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 302us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135570.713906:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00010000:00010000:2.0:1783135570.713979:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.713988:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135570.714071:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783135570.714077:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135570.714158:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714175:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714188:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edfe62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714195:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edfe62 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714202:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edfe62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714209:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135570.714223:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edfe62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714232:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edfe62 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714244:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135570.714247:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135570.714251:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edfe62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714259:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edfe62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714272:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfe69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714279:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfe69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714284:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfe69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714290:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135570.714293:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfe69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714298:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfe69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714307:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424cde00) 00010000:00010000:2.0:1783135570.714309:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135570.714318:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfe69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714325:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfe69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714367:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edfe5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c7b expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714384:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c7b expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135570.714392:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:2.0:1783135570.714395:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135570.714398:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909000, rc 0) 00000100:00100000:2.0:1783135570.714436:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:11235:x1869752786003712:12345-192.168.204.6@tcp:101:stat.0 Request processed in 19722us (20422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135570.714445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:2.0:1783135570.784913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135570.785077:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786004352 00000100:00100000:3.0:1783135570.785123:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786004352 00000100:00100000:3.0:1783135570.785216:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:3.0:1783135570.785228:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:11241:x1869752786004352:12345-192.168.204.6@tcp:36:truncate.0 00010000:00010000:3.0:1783135570.785312:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135570.785351:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628edfe70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c7b expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.785376:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135570.785381:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135570.785613:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.786013:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.786026:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135570.786140:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1783135570.786171:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd89ce6f reply state 0000000026f5c9a7 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.786443:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135570.786452:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135570.786455:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135570.786458:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135570.786876:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+45:11241:x1869752786004352:12345-192.168.204.6@tcp:36:truncate.0 Request processed in 1645us (1982us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1783135570.787044:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 64 00000020:00080000:3.0:1783135570.787052:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783135570.803023:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135570.978959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135570.979066:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786004480 00000100:00100000:0.0:1783135570.979079:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786004480 00000100:00100000:0.0:1783135570.979239:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:0.0:1783135570.979251:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+45:11255:x1869752786004480:12345-192.168.204.6@tcp:101:stat.0 00010000:00010000:0.0:1783135570.979286:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135570.979313:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c82 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979409:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfe85 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979427:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfe85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979441:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfe85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979481:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfe8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979494:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfe8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979502:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfe8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979596:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979606:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979612:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135570.979677:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1783135570.979682:0:13464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135570.979709:0:13464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979724:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979734:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfe85 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979741:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfe85 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979759:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfe85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979766:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135570.979771:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfe85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979779:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfe85 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979794:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135570.979797:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135570.979802:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfe85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979809:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfe85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979826:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfe8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979831:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfe8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979836:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfe8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979840:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65cc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135570.979843:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfe8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979874:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfe8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979883:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424cde00) 00010000:00010000:0.0:1783135570.979886:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135570.979889:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfe8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979895:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfe8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979930:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628edfe7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c82 expref: 47 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979948:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c82 expref: 46 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135570.979955:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135570.979957:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135570.979960:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d200, rc 0) 00000100:00100000:0.0:1783135570.980063:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+46:11255:x1869752786004480:12345-192.168.204.6@tcp:101:stat.0 Request processed in 812us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135570.980072:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:0.0:1783135571.096502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135571.096878:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786004736 00000100:00100000:2.0:1783135571.096894:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786004736 00000100:00100000:2.0:1783135571.096986:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:2.0:1783135571.096999:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+46:11265:x1869752786004736:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135571.097030:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135571.097058:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edfe9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c89 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135571.097264:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1783135571.097406:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edfe9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c89 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.097521:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:2.0:1783135571.097525:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135571.097531:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edfe9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c89 expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.097552:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909c00, rc 0) 00000100:00100000:2.0:1783135571.097724:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+47:11265:x1869752786004736:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 726us (1239us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1783135571.097734:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:3.0:1783135571.108871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135571.109142:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786004992 00000100:00100000:1.0:1783135571.109159:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786004992 00000100:00100000:1.0:1783135571.109231:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:1.0:1783135571.109244:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+47:11265:x1869752786004992:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:1.0:1783135571.109665:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+48:11265:x1869752786004992:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 420us (817us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1783135571.109675:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:3.0:1783135571.185733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135571.186901:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786005248 00000100:00100000:0.0:1783135571.186920:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786005248 00000100:00100000:0.0:1783135571.187021:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:0.0:1783135571.187036:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+48:11270:x1869752786005248:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1783135571.187262:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135571.187293:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfea8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c90 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.187454:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.187474:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c82 expref: 49 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.187485:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.187532:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c82 expref: 49 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.187547:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c82 expref: 49 pid: 13464 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135571.187563:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809167232:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135571.187930:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543af5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135571.193565:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135571.194318:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809167232:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135571.194348:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786005376 00000100:00100000:2.0:1783135571.194358:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786005376 00010000:00010000:3.0:1783135571.194367:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.194415:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c82 expref: 50 pid: 13464 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135571.194503:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1783135571.194515:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac64887e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+50:2400:x1869752786005376:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135571.194537:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135571.194544:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c82 expref: 50 pid: 13464 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.194558:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c82 expref: 50 pid: 13464 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.194589:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628edfe93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c82 expref: 50 pid: 13464 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.194637:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:2.0:1783135571.194642:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.194655:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.194664:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.194698:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135571.194792:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac64887e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+49:2400:x1869752786005376:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 278us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135571.194802:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00010000:00010000:3.0:1783135571.195364:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.195402:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135571.195431:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1783135571.196442:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edfea8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c90 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.196473:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c90 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.196483:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135571.196486:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135571.196489:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c200, rc 0) 00000100:00100000:3.0:1783135571.196575:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+49:11270:x1869752786005248:12345-192.168.204.6@tcp:101:bash.0 Request processed in 9542us (10855us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1783135571.196585:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:0.0:1783135571.208250:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135571.208522:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786005632 00000100:00100000:2.0:1783135571.208538:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786005632 00000100:00100000:2.0:1783135571.208632:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:2.0:1783135571.208644:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+49:11270:x1869752786005632:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:2.0:1783135571.208998:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.209022:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.209039:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135571.209122:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1783135571.209149:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000491d6f6a reply state 000000000607d854 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.209182:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.209191:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:2.0:1783135571.209194:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135571.209198:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135571.209328:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:11270:x1869752786005632:12345-192.168.204.6@tcp:36:bash.0 Request processed in 686us (1094us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1783135571.209337:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 68 00000020:00080000:2.0:1783135571.209343:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783135571.226412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135571.226526:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786005760 00000100:00100000:1.0:1783135571.226540:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786005760 00000100:00100000:1.0:1783135571.226627:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:1.0:1783135571.226639:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:11270:x1869752786005760:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135571.226672:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135571.226714:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edfec4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c97 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.226867:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.226887:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c90 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.226897:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.226944:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c90 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.226959:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c90 expref: 53 pid: 6522 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135571.226974:0:8461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809167360:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135571.227137:0:8461:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dacd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135571.233547:0:8461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809167360:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135571.233599:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135571.236516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135571.236928:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786005888 00000100:00100000:0.0:1783135571.236942:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786005888 00010000:00010000:0.0:1783135571.237002:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c90 expref: 54 pid: 6522 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135571.237048:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:0.0:1783135571.237080:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:2401:x1869752786005888:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135571.237150:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135571.237159:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c90 expref: 54 pid: 6522 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.237176:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c90 expref: 54 pid: 6522 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.237205:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628edfeaf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c90 expref: 54 pid: 6522 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.237228:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135571.237233:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.237244:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.237253:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.237280:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135571.237357:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+53:2401:x1869752786005888:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 280us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135571.237365:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 58 00010000:00010000:1.0:1783135571.239150:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.239171:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135571.239249:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783135571.239254:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135571.239288:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.239337:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edfec4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c97 expref: 53 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.239360:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c97 expref: 52 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.239440:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:1.0:1783135571.239444:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135571.239448:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b400, rc 0) 00000100:00100000:1.0:1783135571.239540:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:11270:x1869752786005760:12345-192.168.204.6@tcp:101:bash.0 Request processed in 12902us (13141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135571.239550:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:2.0:1783135571.246891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135571.247269:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786006144 00000100:00100000:1.0:1783135571.247307:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786006144 00000100:00100000:1.0:1783135571.247384:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:1.0:1783135571.247398:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6580b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:11270:x1869752786006144:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:1.0:1783135571.249968:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6580b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+53:11270:x1869752786006144:12345-192.168.204.6@tcp:35:bash.0 Request processed in 2552us (3077us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1783135571.249986:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:2.0:1783135571.310869:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135571.310907:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809167488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135571.311011:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135571.311119:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809167488 00000100:00100000:3.0:1783135571.311131:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809167488 00000100:00100000:3.0:1783135571.311211:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783135571.311224:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809167488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135571.311274:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783135571.311335:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809167488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135571.311344:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1783135571.311456:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809167488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135571.367319:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135571.367461:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786006400 00000100:00100000:0.0:1783135571.367475:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786006400 00000100:00100000:0.0:1783135571.367581:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:0.0:1783135571.367594:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54383ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+53:11281:x1869752786006400:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135571.367641:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135571.367671:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfed2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140c9e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135571.367860:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783135571.368020:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfed2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c9e expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.368039:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:0.0:1783135571.368042:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135571.368049:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edfed2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c9e expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.368068:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d400, rc 0) 00000100:00100000:0.0:1783135571.368210:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54383ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:11281:x1869752786006400:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 619us (910us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1783135571.368218:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:3.0:1783135571.370927:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135571.371042:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786006528 00000100:00100000:2.0:1783135571.371053:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786006528 00000100:00100000:2.0:1783135571.371144:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 71 00000100:00100000:2.0:1783135571.371155:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:11281:x1869752786006528:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:2.0:1783135571.371242:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edfee0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.371259:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edfee0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.371272:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edfee0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.371308:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628edfee7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.371316:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628edfee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.371325:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628edfee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372669:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372694:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372705:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135571.372765:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372780:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edfee0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372786:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edfee0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372792:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edfee0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372798:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135571.372802:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edfee0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372824:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edfee0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372837:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135571.372840:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135571.372860:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edfee0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372866:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edfee0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372883:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628edfee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372888:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628edfee7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372895:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628edfee7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372900:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135571.372903:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628edfee7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372908:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628edfee7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372915:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424cde00) 00010000:00010000:2.0:1783135571.372917:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135571.372920:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628edfee7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372934:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628edfee7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372944:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372950:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372956:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372961:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135571.372964:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372970:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372977:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:2.0:1783135571.372979:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135571.372982:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.372993:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628edfeee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135571.373101:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:11281:x1869752786006528:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 1929us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135571.373113:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 71 00000001:00080000:1.0:1783135571.379039:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000004:00080000:1.0:1783135571.379130:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1783135571.379148:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ac543072180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1783135571.379156:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac67c741800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ac543072e40 00000020:00080000:1.0:1783135571.379160:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac67c741700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac649351000 00010000:00010000:0.0:1783135571.379220:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379240:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379249:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379256:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135571.379290:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379301:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379325:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ac5424cdb00) 00010000:00010000:0.0:1783135571.379329:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135571.379336:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379342:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628edfd04 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379379:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379388:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379394:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379400:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135571.379404:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379410:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783135571.379420:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:0.0:1783135571.379423:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135571.379429:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135571.379444:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379450:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628edfd0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379472:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379479:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379485:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379490:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135571.379494:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379500:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783135571.379619:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:0.0:1783135571.379656:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424cde00) 00010000:00010000:0.0:1783135571.379660:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135571.379664:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379670:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628edfd4a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.379689:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135571.379983:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135571.380010:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809167616:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783135571.380028:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380036:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380043:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135571.380048:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380056:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380068:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135571.380071:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135571.380075:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380080:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628edfe54 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135571.380137:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135571.380146:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380155:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380161:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380166:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135571.380176:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380184:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380198:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135571.380201:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135571.380205:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380212:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031c00/0xf7de4ef628edfe77 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380231:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380238:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380244:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380249:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135571.380251:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380257:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380268:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135571.380270:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135571.380280:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380286:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628edfebd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135571.380313:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809167616 00000100:00100000:2.0:1783135571.380326:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809167616 00000100:00100000:2.0:1783135571.380412:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783135571.380423:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809167616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783135571.380454:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1783135571.380505:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a487d51, atime: 0x6a487d52, ctime: 0x6a487d51, blocks: 0x8 00010000:00010000:2.0:1783135571.380514:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37fbcbc/0xf7de4ef628edfef5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.380531:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=475s v=(0 0) 00010000:00010000:2.0:1783135571.380536:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135571.380544:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c37fbcbc/0xf7de4ef628edfef5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.380562:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c37fbcbc/0xf7de4ef628edfef5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.380572:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c37fbcbc/0xf7de4ef628edfef5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.380580:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c37fbcbc/0xf7de4ef628edfef5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.380596:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783135571.380733:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1869752809167616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 312us (598us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783135571.380750:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:2.0:1783135571.380799:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac67b3b1f80/2, rc 0, transno 4294967302 00000100:00100000:2.0:1783135571.380805:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809167616:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1783135571.380910:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783135571.380932:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135571.380941:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c37fbcbc/0xf7de4ef628edfef5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380952:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135571.380956:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c37fbcbc/0xf7de4ef628edfef5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380965:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c37fbcbc/0xf7de4ef628edfef5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380983:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c37fbcbc/0xf7de4ef628edfef5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.380991:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c37fbcbc/0xf7de4ef628edfef5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.381014:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135571.381016:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135571.381018:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135571.386046:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135571.386785:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786006784 00000100:00100000:1.0:1783135571.386798:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786006784 00000100:00100000:1.0:1783135571.386944:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:1.0:1783135571.386959:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:11281:x1869752786006784:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:1.0:1783135571.388370:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:11281:x1869752786006784:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 1405us (2325us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1783135571.388396:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:2.0:1783135571.506469:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135571.511777:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786007040 00000100:00100000:1.0:1783135571.511791:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786007040 00000100:00100000:1.0:1783135571.512058:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:1.0:1783135571.512072:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:11284:x1869752786007040:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135571.512131:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135571.512151:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edfefc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ca5 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512237:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff03 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512254:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512267:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512281:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512288:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512295:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512425:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628edff11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512435:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628edff11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512443:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628edff11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135571.512454:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783135571.512542:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512550:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff03 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512558:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512564:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51ba00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135571.512568:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512576:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff03 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512587:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:1.0:1783135571.512590:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135571.512594:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512599:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512612:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512633:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512639:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512643:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135571.512652:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512658:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512666:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac65800c500) 00010000:00010000:1.0:1783135571.512668:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135571.512671:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512676:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512736:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edfefc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ca5 expref: 16 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512750:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628edff11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ca5 expref: 15 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.512758:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:1.0:1783135571.512760:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135571.512763:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51bc00, rc 0) 00000100:00100000:1.0:1783135571.515197:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:11284:x1869752786007040:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 3114us (8724us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1783135571.524915:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:3.0:1783135571.526507:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135571.531387:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135571.531506:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786007296 00000100:00100000:1.0:1783135571.531527:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786007296 00000100:00100000:1.0:1783135571.531648:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:1.0:1783135571.531660:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:2400:x1869752786007296:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135571.531705:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135571.531733:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628edff11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ca5 expref: 15 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.531757:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:1.0:1783135571.531763:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135571.531848:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:2400:x1869752786007296:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 182us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135571.531857:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:0.0:1783135571.536195:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786007168 00000100:00100000:0.0:1783135571.536221:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786007168 00000100:00100000:0.0:1783135571.536435:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:0.0:1783135571.536450:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:11284:x1869752786007168:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:0.0:1783135571.536562:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edff1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.536602:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edff1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.536619:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edff1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.536678:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edff1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.536687:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edff1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.536696:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edff1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.536703:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135571.536708:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edff1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.536717:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edff1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.536744:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135571.536748:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135571.536754:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edff1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.536783:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628edff1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135571.536920:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:11284:x1869752786007168:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 473us (10428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135571.536928:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:3.0:1783135571.546961:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135571.549359:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786007552 00000100:00100000:1.0:1783135571.549376:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786007552 00000100:00100000:1.0:1783135571.549463:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:1.0:1783135571.549474:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:11284:x1869752786007552:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:1.0:1783135571.549758:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:11284:x1869752786007552:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 284us (2813us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1783135571.549766:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:1.0:1783135571.764708:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135571.765159:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786007808 00000100:00100000:3.0:1783135571.765173:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786007808 00000100:00100000:3.0:1783135571.765267:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 74 00000100:00100000:3.0:1783135571.765279:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:11302:x1869752786007808:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:3.0:1783135571.765317:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135571.765353:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140cac expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.765519:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.765539:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.765553:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135571.765568:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783135571.766136:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cac expref: 18 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.766167:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cac expref: 17 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.766177:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135571.766180:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783135571.766184:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640031200, rc 0) 00000100:00100000:3.0:1783135571.766335:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11302:x1869752786007808:12345-192.168.204.6@tcp:101:cat.0 Request processed in 1057us (1644us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1783135571.766371:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 74 00000100:00100000:0.0:1783135571.804052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135571.806797:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786007936 00000100:00100000:1.0:1783135571.806824:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786007936 00000100:00100000:1.0:1783135571.806959:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 75 00000100:00100000:1.0:1783135571.806971:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11303:x1869752786007936:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135571.807009:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135571.808367:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628edff3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140cb3 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.810543:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edff42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.810586:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edff42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.810601:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edff42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135571.810709:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1783135571.810713:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135571.810735:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edff42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.810774:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628edff3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cb3 expref: 19 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.810800:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edff42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cb3 expref: 18 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135571.810809:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:1.0:1783135571.810812:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135571.810815:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b200, rc 0) 00000100:00100000:1.0:1783135571.811031:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11303:x1869752786007936:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 4061us (6999us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135571.811041:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 75 00010000:00010000:0.0:1783135571.830590:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135571.838935:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135571.839058:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786008320 00000100:00100000:1.0:1783135571.839073:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786008320 00000100:00100000:2.0:1783135571.839701:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:2.0:1783135571.839716:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11303:x1869752786008320:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1783135571.840047:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11303:x1869752786008320:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 335us (1128us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1783135571.840056:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:3.0:1783135571.847259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135571.847860:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786008448 00000100:00100000:0.0:1783135571.847876:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786008448 00000100:00100000:0.0:1783135571.848434:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:0.0:1783135571.848459:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11303:x1869752786008448:12345-192.168.204.6@tcp:103:lfs.0 00010000:00010000:0.0:1783135571.848479:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783135571.848564:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628edfecb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c97 expref: 19 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.848595:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cac expref: 18 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.852980:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628edfdc8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c51 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135571.853004:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135571.853009:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135571.853192:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11303:x1869752786008448:12345-192.168.204.6@tcp:103:lfs.0 Request processed in 4637us (5842us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135571.853227:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:0.0:1783135571.859954:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135571.866049:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786008576 00000100:00100000:3.0:1783135571.866075:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786008576 00000100:00100000:2.0:1783135571.866317:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 76 00000100:00100000:2.0:1783135571.866334:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11303:x1869752786008576:12345-192.168.204.6@tcp:58:lfs.0 00010000:00010000:2.0:1783135571.866472:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edff49 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.866501:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edff49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135571.866515:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edff49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135571.866959:0:6522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135571.870386:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1783135571.870600:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1783135571.870752:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11303:x1869752786008576:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 4417us (10898us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135571.870765:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 76 00000100:00100000:2.0:1783135571.914756:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135571.914961:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786008704 00000100:00100000:3.0:1783135571.914976:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786008704 00000100:00100000:3.0:1783135571.915075:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:3.0:1783135571.915138:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11305:x1869752786008704:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135571.915168:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135571.915200:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140cba expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915307:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915326:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915341:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915360:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915368:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915375:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915775:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915809:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915823:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135571.915904:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783135571.915910:0:13464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135571.915939:0:13464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915952:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915963:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915970:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915977:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915984:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135571.915989:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.915997:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916033:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:3.0:1783135571.916037:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135571.916045:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916051:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916069:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916076:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916178:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916183:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135571.916185:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916191:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916200:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac67c491e00) 00010000:00010000:3.0:1783135571.916202:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135571.916204:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916209:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916270:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cba expref: 18 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916301:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cba expref: 17 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135571.916310:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135571.916312:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135571.916315:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640031200, rc 0) 00000100:00100000:3.0:1783135571.916410:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11305:x1869752786008704:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1323us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135571.916420:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:3.0:1783135572.535434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135572.535481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135572.535524:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135572.535552:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135572.535584:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135572.535625:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786008960 00000100:00100000:3.0:1783135572.535637:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786008960 00000100:00100000:3.0:1783135572.535728:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786009216 00000100:00100000:3.0:1783135572.535732:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786009216 00000100:00100000:3.0:1783135572.535756:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786009344 00000100:00100000:3.0:1783135572.535759:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786009344 00000100:00100000:3.0:1783135572.535783:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 330 00000100:00100000:3.0:1783135572.535794:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752786008960:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135572.535922:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752786008960:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 129us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135572.535951:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 330 00000100:00100000:3.0:1783135572.535976:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 331 00000100:00100000:3.0:1783135572.535982:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752786009216:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135572.536012:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752786009216:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135572.536018:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 331 00000100:00100000:3.0:1783135572.536028:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 332 00000100:00100000:3.0:1783135572.536034:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752786009344:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135572.536058:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752786009344:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135572.536065:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 332 00000100:00100000:3.0:1783135572.536113:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786008832 00000100:00100000:3.0:1783135572.536118:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786008832 00000100:00100000:3.0:1783135572.536147:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 391 00000100:00100000:3.0:1783135572.536154:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2401:x1869752786008832:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135572.536181:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2401:x1869752786008832:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135572.536187:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 391 00000100:00100000:3.0:1783135572.536219:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786009088 00000100:00100000:3.0:1783135572.536223:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786009088 00000100:00100000:3.0:1783135572.536261:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00100000:3.0:1783135572.536267:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752786009088:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135572.536314:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752786009088:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 46us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135572.536328:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00080000:3.0:1783135572.536352:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135572.536358:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135572.536360:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1783135572.595542:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135572.595570:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135572.595915:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783135572.595938:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135572.596190:0:13815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5437a5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809167744:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135572.596443:0:13815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543af5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135572.603507:0:13815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5437a5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809167744:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135572.603940:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135572.604016:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786009472 00000100:00100000:0.0:1783135572.604034:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786009472 00000100:00100000:0.0:1783135572.604148:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:0.0:1783135572.604161:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11316:x1869752786009472:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135572.604196:0:6524:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1783135572.604335:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135572.604344:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11316:x1869752786009472:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 183us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135572.604354:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:1.0:1783135572.643274:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135572.648392:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786009600 00000100:00100000:3.0:1783135572.648409:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786009600 00000100:00100000:3.0:1783135572.648498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:3.0:1783135572.648510:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11316:x1869752786009600:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783135572.648612:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff6c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648632:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648647:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648705:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff73 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648714:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648720:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648749:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648756:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648780:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135572.648847:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783135572.648852:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135572.648870:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648885:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648892:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff6c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648900:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff6c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648906:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135572.648910:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff6c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648918:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff6c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648933:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:3.0:1783135572.648936:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135572.648940:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648946:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628edff6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648974:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648987:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff73 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.648994:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649000:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135572.649003:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649009:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff73 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649018:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8ac67c491e00) 00010000:00010000:3.0:1783135572.649020:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135572.649023:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff73 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649028:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628edff73 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649043:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649049:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649055:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649069:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135572.649072:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649078:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649137:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135572.649141:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135572.649144:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135572.649149:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628edff7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135572.649251:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11316:x1869752786009600:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 Request processed in 741us (5983us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135572.649261:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:3.0:1783135572.655106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135572.658394:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786009856 00000100:00100000:1.0:1783135572.658413:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786009856 00000100:00100000:1.0:1783135572.658505:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:1.0:1783135572.658516:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11316:x1869752786009856:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135572.658538:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135572.658559:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140cc1 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.658673:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.658690:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.658702:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135572.658713:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783135572.658881:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.658890:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.658897:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.658903:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51ba00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135572.658907:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.658914:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.658938:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:1.0:1783135572.658941:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135572.658946:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.658952:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edff88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.658992:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff81 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cc1 expref: 19 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.659002:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:1.0:1783135572.659005:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135572.659008:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edff81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cc1 expref: 19 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.659018:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a800, rc 0) 00000100:00100000:1.0:1783135572.659118:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11316:x1869752786009856:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 604us (4037us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1783135572.659127:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:2.0:1783135572.665772:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135572.666450:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786009984 00000100:00100000:3.0:1783135572.666468:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786009984 00000100:00100000:3.0:1783135572.667185:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:3.0:1783135572.667255:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11316:x1869752786009984:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783135572.667385:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783135572.668561:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11316:x1869752786009984:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 1351us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135572.668578:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:3.0:1783135572.684182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135572.684320:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786010240 00000100:00100000:0.0:1783135572.684330:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786010240 00000100:00100000:0.0:1783135572.684397:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:0.0:1783135572.684409:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11316:x1869752786010240:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135572.684431:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135572.684434:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783135572.684464:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edff42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cb3 expref: 18 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.684483:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135572.684494:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135572.684511:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edff96 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140cc8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135572.686422:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1783135572.686618:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edff9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.686634:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edff9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.686645:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edff9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.686712:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edff96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cc8 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.686734:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edff9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cc8 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.686743:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac5424cdb00) 00010000:00010000:0.0:1783135572.686746:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135572.686750:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65cc00, rc 0) 00000100:00100000:0.0:1783135572.686958:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11316:x1869752786010240:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 2549us (2787us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783135572.686969:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:2.0:1783135572.712217:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135572.713040:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786010496 00000100:00100000:1.0:1783135572.713052:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786010496 00000100:00100000:1.0:1783135572.713134:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:1.0:1783135572.713145:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11316:x1869752786010496:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135572.713231:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135572.713264:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628edff9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cc8 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713301:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac5424cdb00) 00010000:00010000:1.0:1783135572.713314:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135572.713340:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edffab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713355:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edffab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713365:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edffab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713433:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xfefff80c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713442:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfefff80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713448:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfefff80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713495:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edffab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713502:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edffab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713508:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edffab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713514:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135572.713519:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edffab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713537:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edffab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713545:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:1.0:1783135572.713548:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135572.713551:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edffab lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713556:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628edffab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713565:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfefff80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713571:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffb2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfefff80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713576:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfefff80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713580:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51ba00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135572.713583:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffb2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfefff80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713588:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffb2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfefff80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713594:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xfefff80c (ffff8ac65800c500) 00010000:00010000:1.0:1783135572.713596:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135572.713599:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffb2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfefff80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.713614:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffb2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfefff80c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135572.713847:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11316:x1869752786010496:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 560us (1497us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135572.714185:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:2.0:1783135572.717293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135572.717344:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786010624 00000100:00100000:1.0:1783135572.717355:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786010624 00000100:00100000:1.0:1783135572.717419:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 84 00000100:00100000:1.0:1783135572.717430:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11316:x1869752786010624:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135572.717453:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135572.717480:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628edffb9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ccf expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.717522:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.717536:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.717549:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.717664:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628edffb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ccf expref: 20 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.717682:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ccf expref: 19 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.717776:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:1.0:1783135572.717780:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135572.717785:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a200, rc 0) 00000100:00100000:1.0:1783135572.717994:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11316:x1869752786010624:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 564us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135572.718002:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 84 00000100:00100000:2.0:1783135572.728447:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135572.728644:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786010880 00000100:00100000:0.0:1783135572.728656:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786010880 00000100:00100000:0.0:1783135572.728734:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 85 00000100:00100000:0.0:1783135572.728745:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11316:x1869752786010880:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783135572.728866:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.728884:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.728896:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135572.731637:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1783135572.731660:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 476524572050ns, next at 477524568484ns, rc = 0 00000004:00010000:0.0:1783135572.732002:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001efbf9bc reply state 00000000a900368f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.732024:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.732034:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:0.0:1783135572.732037:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783135572.732041:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135572.732200:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:11316:x1869752786010880:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 3453us (3759us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1783135572.732211:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 85 00000100:00100000:2.0:1783135572.741060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135572.741460:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786011008 00000100:00100000:1.0:1783135572.741470:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786011008 00000100:00100000:1.0:1783135572.741539:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 86 00000100:00100000:1.0:1783135572.741550:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:11316:x1869752786011008:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135572.741574:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135572.741594:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140cd6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.741652:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cd6 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.741668:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cd6 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.741687:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:1.0:1783135572.741690:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135572.741693:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51ba00, rc 0) 00000100:00100000:1.0:1783135572.741764:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11316:x1869752786011008:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 216us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135572.741781:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 86 00000100:00100000:3.0:1783135572.749743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135572.749848:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786011136 00000100:00100000:0.0:1783135572.749982:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786011136 00000100:00100000:0.0:1783135572.750042:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:0.0:1783135572.750050:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1869752786011136:12345-192.168.204.6@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1783135572.750082:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:0.0:1783135572.750137:0:8435:0:(genops.c:1406:class_connect()) connect: client 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe, cookie 0xf7de4ef628edffd5 00002000:00100000:0.0:1783135572.750167:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe/ffff8ac65077e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135572.750186:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135572.750405:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783135572.750440:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8ac65077a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135572.750518:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2397:x1869752786011136:12345-192.168.204.6@tcp:8:lhsmtool_posix.0 Request processed in 467us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135572.750527:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:2.0:1783135572.765191:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135572.767202:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786011264 00000100:00100000:3.0:1783135572.767232:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786011264 00000100:00100000:3.0:1783135572.767316:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:3.0:1783135572.767328:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:0:x1869752786011264:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00000001:00080000:3.0:1783135572.772316:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1783135572.772332:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000100:00080000:2.0:1783135572.773344:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135572.784487:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:0:x1869752786011264:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 17149us (19296us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783135572.784503:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:2.0:1783135572.791894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135572.792037:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786011520 00000100:00100000:1.0:1783135572.792048:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786011520 00000100:00100000:1.0:1783135572.792152:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:1.0:1783135572.792163:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11316:x1869752786011520:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783135572.792415:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:11316:x1869752786011520:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 253us (531us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1783135572.792423:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:3.0:1783135572.796788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135572.797061:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786011776 00000100:00100000:2.0:1783135572.797072:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786011776 00000100:00100000:2.0:1783135572.797176:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 87 00000100:00100000:2.0:1783135572.797188:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:11316:x1869752786011776:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135572.797303:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:11316:x1869752786011776:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 117us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135572.797310:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 87 00000100:00100000:3.0:1783135572.801789:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135572.803587:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786011904 00000100:00100000:0.0:1783135572.803605:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786011904 00000100:00100000:2.0:1783135572.807358:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:2.0:1783135572.807375:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:11316:x1869752786011904:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135572.807398:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135572.807422:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edffdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140cdd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.807526:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edffe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.807541:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edffe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.807553:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edffe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135572.807618:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135572.807644:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edffe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.807686:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628edffdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cdd expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.807979:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edffe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cdd expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.807990:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:2.0:1783135572.807993:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783135572.807996:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909c00, rc 0) 00000100:00100000:2.0:1783135572.808074:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:11316:x1869752786011904:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 703us (6299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135572.808081:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:0.0:1783135572.824157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135572.824263:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786012032 00000100:00100000:2.0:1783135572.824274:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786012032 00000100:00100000:2.0:1783135572.824352:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:2.0:1783135572.824379:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786012032:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135572.824401:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135572.824427:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ccf1294/0xf7de4ef628edffea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ce4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135572.824453:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487d55, blocks: 0x0 00010000:00010000:2.0:1783135572.824472:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=476s v=(0 0) 00010000:00010000:2.0:1783135572.824476:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135572.824485:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ccf1294/0xf7de4ef628edffea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ce4 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.824505:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ccf1294/0xf7de4ef628edffea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ce4 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.824517:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908a00, rc 0) 00000100:00100000:2.0:1783135572.824586:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752786012032:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 210us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135572.824594:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:3.0:1783135572.831780:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135572.832367:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786012288 00000100:00100000:0.0:1783135572.832378:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786012288 00000100:00100000:0.0:1783135572.832452:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:0.0:1783135572.832465:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:11316:x1869752786012288:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783135572.832589:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:11316:x1869752786012288:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 126us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135572.832597:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:0.0:1783135572.844185:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135572.844296:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786012416 00000100:00100000:2.0:1783135572.844308:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786012416 00000100:00100000:2.0:1783135572.844423:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:2.0:1783135572.844435:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:11316:x1869752786012416:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135572.844754:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135572.844777:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ceb expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.844840:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ccf1294/0xf7de4ef628edffea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ce4 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.844850:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135572.844854:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135572.844859:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.844896:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ccf1294/0xf7de4ef628edffea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ce4 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.844911:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ccf1294/0xf7de4ef628edffea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ce4 expref: 7 pid: 8435 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135572.844925:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6750d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1869752809167872:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135572.845037:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bcea0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1783135572.848976:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135572.849187:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6750d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1869752809167872:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135572.849225:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.849247:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909000, rc 0) 00000100:00100000:2.0:1783135572.849312:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:11316:x1869752786012416:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 4878us (5136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135572.849322:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:0.0:1783135572.850798:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135572.850912:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786012544 00000100:00100000:0.0:1783135572.850921:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786012544 00010000:00010000:0.0:1783135572.850964:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ccf1294/0xf7de4ef628edffea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ce4 expref: 7 pid: 8435 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135572.850999:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:0.0:1783135572.851009:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786012544:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135572.851042:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135572.851064:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ccf1294/0xf7de4ef628edffea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ce4 expref: 7 pid: 8435 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.851078:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ccf1294/0xf7de4ef628edffea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ce4 expref: 7 pid: 8435 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.851119:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ccf1294/0xf7de4ef628edffea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ce4 expref: 7 pid: 8435 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.851136:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135572.851140:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135572.851148:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.851159:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.851198:0:10344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135572.851214:0:10344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10344:1869752809168000:192.168.204.6@tcp:105: 00000100:00100000:0.0:1783135572.851296:0:10344:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543af5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135572.857707:0:10344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10344:1869752809168000:192.168.204.6@tcp:105: 00010000:00010000:2.0:1783135572.857736:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135572.857797:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752786012544:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 6788us (7004us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135572.857809:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:3.0:1783135572.870625:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135572.876612:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786012672 00000100:00100000:2.0:1783135572.876628:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786012672 00002000:00100000:2.0:1783135572.876691:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8ac67c60fb80 x1869752786012672/t0(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:743/0 lens 504/0 e 0 to 0 dl 1783135583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135572.876702:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac67c60fb80 with x1869752786012672 ext(0->8) 00002000:00010000:2.0:1783135572.876708:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac67c60fb80 00000100:00100000:2.0:1783135572.876774:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:2.0:1783135572.876785:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2401:x1869752786012672:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783135572.879535:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786012672:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 Request processed in 1067us (7237us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783135572.879552:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00002000:00100000:2.0:1783135572.879568:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8ac67c60fb80 x1869752786012672/t4294967303(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:743/0 lens 504/448 e 0 to 0 dl 1783135583 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135572.879579:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac67c60fb80 with x1869752786012672 ext(0->8) 00002000:00010000:2.0:1783135572.879585:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac67c60fb80 00000100:00100000:3.0:1783135572.889497:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135572.893238:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786012800 00000100:00100000:0.0:1783135572.893257:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786012800 00000100:00100000:0.0:1783135572.893322:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 90 00000100:00100000:0.0:1783135572.893342:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:11316:x1869752786012800:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783135572.901418:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1783135572.901452:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1783135572.901489:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1783135572.901593:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1783135572.901603:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1783135572.901620:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809168128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783135572.901689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135572.901854:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.901869:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.901878:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.901884:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135572.901890:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.901898:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.901916:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:1.0:1783135572.901935:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783135572.901941:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.901947:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628edffc7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135572.902151:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809168128 00000100:00100000:0.0:1783135572.902162:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809168128 00000100:00100000:0.0:1783135572.902234:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783135572.902244:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809168128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783135572.902385:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783135572.902389:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783135573 00002000:00010000:0.0:1783135572.902392:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783135572.902394:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783135573 -> 1783135573 00002000:00010000:0.0:1783135572.902397:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00080000:1.0:1783135572.902527:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135572.902557:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1869752809168128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 314us (867us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783135572.902565:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783135572.902777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:11316:x1869752786012800:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 Request processed in 9435us (13290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135572.902786:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 90 00000004:00080000:0.0:1783135572.902839:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac67f84fb80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1783135572.902855:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809168128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783135572.915034:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135572.915122:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786012928 00000100:00100000:1.0:1783135572.915132:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786012928 00000100:00100000:1.0:1783135572.915183:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:1.0:1783135572.915193:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786012928:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783135572.916590:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1783135572.916606:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1783135572.916726:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2401:x1869752786012928:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 Request processed in 1529us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135572.916736:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:1.0:1783135572.920273:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135572.920350:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786013184 00000100:00100000:2.0:1783135572.920361:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786013184 00000100:00100000:2.0:1783135572.920429:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 91 00000100:00100000:2.0:1783135572.920440:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:11316:x1869752786013184:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135572.920528:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135572.920563:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628edffe3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cdd expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.920584:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:2.0:1783135572.920590:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135572.921671:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.921692:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.921714:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135572.921882:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fabbe78b reply state 00000000f1b0cd3d transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.921896:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.921903:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:2.0:1783135572.921906:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135572.921910:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135572.922026:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:11316:x1869752786013184:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 1585us (1759us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1783135572.922034:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 91 00000100:00100000:1.0:1783135572.929978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135572.930155:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786013312 00000100:00100000:0.0:1783135572.930179:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786013312 00000100:00100000:0.0:1783135572.930231:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:0.0:1783135572.930241:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752786013312:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783135572.930404:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1783135572.930407:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783135573 -> 1783135571 00002000:00010000:0.0:1783135572.930409:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783135570 00002000:00010000:0.0:1783135572.930412:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783135573 -> 1783135571 00002000:00010000:0.0:1783135572.930414:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1783135572.930476:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786013312:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 235us (508us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1783135572.930484:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:2.0:1783135572.951217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135572.951323:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786013568 00000100:00100000:1.0:1783135572.951337:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786013568 00000100:00100000:1.0:1783135572.951418:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 92 00000100:00100000:1.0:1783135572.951429:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:11316:x1869752786013568:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783135572.951513:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.951536:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ccf expref: 15 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.951559:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.951603:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ccf expref: 15 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.951618:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ccf expref: 15 pid: 13464 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135572.951635:0:8461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d99880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809168256:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135572.951954:0:8461:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dacc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135572.960461:0:8461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d99880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809168256:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135572.960495:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135572.966301:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135572.967224:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786013696 00000100:00100000:0.0:1783135572.967239:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786013696 00010000:00010000:0.0:1783135572.967286:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ccf expref: 16 pid: 13464 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135572.968858:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:0.0:1783135572.968880:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:2400:x1869752786013696:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135572.968901:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135572.968913:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ccf expref: 16 pid: 13464 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.968931:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ccf expref: 16 pid: 13464 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.968954:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628edffc0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ccf expref: 16 pid: 13464 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.968982:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:0.0:1783135572.968987:0:10346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.968998:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.969005:0:10346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135572.969034:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135572.969125:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:2400:x1869752786013696:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 254us (2835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135572.969133:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00010000:00010000:1.0:1783135572.973271:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.973291:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.973340:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.973348:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.973356:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.973363:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135572.973369:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.973396:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.973415:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:1.0:1783135572.973418:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783135572.973423:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.973429:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628edffff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135572.973521:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:11316:x1869752786013568:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 Request processed in 22089us (22310us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783135572.973534:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 92 00000100:00100000:1.0:1783135572.986407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135572.986489:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786013824 00000100:00100000:1.0:1783135572.986500:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786013824 00000100:00100000:1.0:1783135572.986575:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:1.0:1783135572.986586:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2399:x1869752786013824:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783135572.986648:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.986684:0:8620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.986694:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135572.987048:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135572.987061:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.987121:0:8620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135572.987136:0:8620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 7 pid: 8438 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135572.987151:0:8620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8620:1869752809168384:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135572.987242:0:8620:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135572.997664:0:8620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8620:1869752809168384:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135572.997698:0:8620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135572.998268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135572.998681:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786013952 00000100:00100000:2.0:1783135572.998759:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786013952 00010000:00010000:2.0:1783135572.998808:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 8 pid: 8438 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135572.998934:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:2.0:1783135572.998947:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2398:x1869752786013952:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135572.998963:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135572.998984:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 8 pid: 8438 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.998998:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 8 pid: 8438 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.999823:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f513deab/0xf7de4ef628edfff1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ceb expref: 8 pid: 8438 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.999850:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135572.999854:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135572.999859:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.999870:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135572.999910:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135573.000000:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2398:x1869752786013952:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 1055us (1734us total) trans 0 rc 0/0 00010000:00010000:3.0:1783135573.000023:0:8620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135573.000030:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 61 00010000:00010000:3.0:1783135573.000041:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.000079:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.000112:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.000122:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.000129:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a000 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135573.000133:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.000142:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.000155:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.000163:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee0006 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135573.000214:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752786013824:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 Request processed in 13630us (13817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135573.000222:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:3.0:1783135573.007891:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.009381:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786014208 00000100:00100000:0.0:1783135573.009397:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786014208 00000100:00100000:0.0:1783135573.009493:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00100000:0.0:1783135573.009506:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:11316:x1869752786014208:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783135573.009600:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.009619:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c74 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.009629:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.009665:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c74 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.009688:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c74 expref: 14 pid: 6524 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135573.009707:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809168512:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135573.009803:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543987300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135573.013826:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809168512:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135573.013865:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135573.014530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.014858:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786014336 00000100:00100000:0.0:1783135573.014868:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786014336 00010000:00010000:0.0:1783135573.014908:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c74 expref: 15 pid: 6524 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135573.014958:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:0.0:1783135573.014968:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6618a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:2401:x1869752786014336:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135573.014986:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135573.014993:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c74 expref: 15 pid: 6524 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015006:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c74 expref: 15 pid: 6524 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015028:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628edfe4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c74 expref: 15 pid: 6524 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015065:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135573.015072:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015081:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015102:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015128:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135573.015185:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6618a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:2401:x1869752786014336:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 218us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135573.015192:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 62 00010000:00010000:0.0:1783135573.015337:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015346:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015708:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015721:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cd6 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015729:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015761:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cd6 expref: 14 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.015781:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cd6 expref: 14 pid: 6524 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135573.015795:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809168640:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135573.015876:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac64a4e4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135573.020665:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809168640:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135573.020709:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135573.021989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135573.022118:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786014464 00000100:00100000:1.0:1783135573.022129:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786014464 00010000:00010000:1.0:1783135573.022182:0:10345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cd6 expref: 15 pid: 6524 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135573.022235:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:1.0:1783135573.022247:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:2401:x1869752786014464:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135573.022267:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135573.022274:0:10345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cd6 expref: 15 pid: 6524 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.022312:0:10345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cd6 expref: 15 pid: 6524 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.022338:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628edffce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cd6 expref: 15 pid: 6524 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.022358:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:1.0:1783135573.022365:0:10345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.022375:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.022383:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.022415:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135573.022469:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:2401:x1869752786014464:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 224us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.022478:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 63 00010000:00010000:3.0:1783135573.022607:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.022614:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135573.022981:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1783135573.027033:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1783135573.027170:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1783135573.027268:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869752809168768:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783135573.027379:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135573.027414:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135573.027443:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809168768 00000100:00100000:3.0:1783135573.027450:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809168768 00000100:00100000:3.0:1783135573.027499:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783135573.027508:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1869752809168768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783135573.027588:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1869752809168768:12345-0@lo:1000:mdt00_000.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135573.027595:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783135573.027641:0:6522:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1783135573.027646:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac67f84fb80, transno 4294967304 00000100:00100000:3.0:1783135573.027659:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869752809168768:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1783135573.027791:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1783135573.029515:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869752809168896:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783135573.029610:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135573.029636:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135573.029789:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809168896 00000100:00100000:2.0:1783135573.029797:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809168896 00000100:00100000:2.0:1783135573.029940:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1783135573.029951:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1869752809168896:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783135573.030144:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1869752809168896:12345-0@lo:1000:mdt00_000.0 Request processed in 194us (534us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783135573.030152:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783135573.030296:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869752809168896:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1783135573.030342:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030353:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030361:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030373:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135573.030378:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030384:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030401:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:1.0:1783135573.030404:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135573.030408:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030414:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0014 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030444:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edff49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030450:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edff49 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030456:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edff49 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030460:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135573.030463:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edff49 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030469:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edff49 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030488:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:1.0:1783135573.030490:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135573.030493:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edff49 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030498:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628edff49 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030519:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030532:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cba expref: 17 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030540:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030574:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cba expref: 17 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.030588:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cba expref: 17 pid: 13464 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135573.030601:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809169024:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135573.030677:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135573.034054:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809169024:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135573.034084:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135573.036077:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135573.036206:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786014592 00000100:00100000:3.0:1783135573.036217:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786014592 00010000:00010000:3.0:1783135573.036271:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cba expref: 18 pid: 13464 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135573.036316:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:3.0:1783135573.036328:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:2400:x1869752786014592:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135573.036346:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135573.036354:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cba expref: 18 pid: 13464 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.036372:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cba expref: 18 pid: 13464 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.036395:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628edff65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cba expref: 18 pid: 13464 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.036410:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:3.0:1783135573.036415:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.036426:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.036434:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.036457:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135573.036514:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:2400:x1869752786014592:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 188us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135573.036534:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 64 00010000:00010000:0.0:1783135573.040038:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040060:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040077:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040083:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040135:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040142:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51aa00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135573.040148:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040156:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040182:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135573.040185:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135573.040191:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040198:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee001b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040211:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040217:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040223:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040227:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65cc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135573.040230:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040236:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040243:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491700) 00010000:00010000:0.0:1783135573.040246:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135573.040248:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.040254:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee000d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135573.040485:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11316:x1869752786014208:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 30976us (32600us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1783135573.040496:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 93 00000020:00080000:0.0:1783135573.040503:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783135573.040547:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135573.040552:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135573.040566:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783135573.040572:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135573.050533:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.050855:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786014848 00000100:00100000:0.0:1783135573.050869:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786014848 00000100:00100000:0.0:1783135573.050943:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:0.0:1783135573.050955:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11316:x1869752786014848:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783135573.051257:0:6526:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783135573.051397:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1783135573.051432:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051553:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051566:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051577:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051584:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051590:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051608:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783135573.051712:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11316:x1869752786014848:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 757us (1190us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1783135573.051721:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000020:00080000:0.0:1783135573.051727:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783135573.051753:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135573.051759:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051766:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135573.051771:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051780:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051793:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:0.0:1783135573.051796:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783135573.051801:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051806:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0022 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.051828:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135573.051830:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135573.051832:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135573.077224:0:14227:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135573.077235:0:14227:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135573.077261:0:14227:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783135573.077267:0:14227:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135573.207682:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.209260:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786015104 00000100:00100000:0.0:1783135573.209278:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786015104 00000100:00100000:0.0:1783135573.209398:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 94 00000100:00100000:0.0:1783135573.209411:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:11326:x1869752786015104:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135573.209441:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135573.209524:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140cf2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.209664:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee0030 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.209680:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee0030 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.209695:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee0030 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135573.209706:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1783135573.209980:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf2 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.210002:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee0030 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf2 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.210011:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135573.210014:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135573.210017:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65cc00, rc 0) 00000100:00100000:0.0:1783135573.210129:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:11326:x1869752786015104:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 721us (2459us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1783135573.210136:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 94 00000100:00100000:1.0:1783135573.215978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135573.222097:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786015232 00000100:00100000:2.0:1783135573.222113:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786015232 00000100:00100000:2.0:1783135573.222175:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 95 00000100:00100000:2.0:1783135573.222186:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:11326:x1869752786015232:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:2.0:1783135573.222264:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee003e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222282:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee003e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222306:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee003e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222381:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0045 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222391:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222399:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222489:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222499:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222505:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135573.222559:0:13464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222574:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee003e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222580:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee003e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222587:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee003e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222603:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135573.222608:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee003e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222617:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee003e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222631:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135573.222635:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135573.222639:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee003e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222647:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee003e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222660:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222666:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0045 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222672:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0045 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222677:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135573.222680:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0045 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222686:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0045 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222705:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac67c558b00) 00010000:00010000:2.0:1783135573.222707:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135573.222709:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0045 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222715:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0045 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222732:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222738:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222743:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222747:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135573.222750:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222755:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222761:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:2.0:1783135573.222763:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135573.222765:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.222770:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee004c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135573.222898:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:11326:x1869752786015232:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 712us (6931us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135573.222906:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 95 00000100:00100000:3.0:1783135573.288901:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135573.288938:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786015488 00000100:00100000:3.0:1783135573.288949:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786015488 00000100:00100000:3.0:1783135573.289010:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 96 00000100:00100000:3.0:1783135573.289020:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:11329:x1869752786015488:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135573.289040:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135573.289058:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0053 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140cf9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289143:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee005a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289158:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee005a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289170:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee005a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289184:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0061 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289192:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0061 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289198:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0061 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289304:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289318:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289325:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135573.289336:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1783135573.289416:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee005a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289424:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee005a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289431:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee005a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289437:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135573.289442:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee005a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289450:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee005a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289462:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:3.0:1783135573.289465:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135573.289470:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee005a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289477:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee005a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289489:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0061 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289501:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0061 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289506:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0061 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289511:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135573.289514:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0061 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289520:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0061 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289528:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac67c491c00) 00010000:00010000:3.0:1783135573.289531:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135573.289534:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0061 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289540:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0061 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289587:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0053 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf9 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289602:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf9 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.289609:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:3.0:1783135573.289611:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135573.289619:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030000, rc 0) 00000100:00100000:3.0:1783135573.289679:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11329:x1869752786015488:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 659us (788us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1783135573.289688:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 96 00000100:00100000:0.0:1783135573.306531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135573.309517:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786015616 00000100:00100000:1.0:1783135573.309552:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786015616 00000100:00100000:0.0:1783135573.309707:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:0.0:1783135573.309719:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11329:x1869752786015616:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:0.0:1783135573.309797:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0076 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.309834:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0076 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.309958:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0076 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.310005:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0076 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.310012:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0076 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.310018:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0076 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.310022:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135573.310026:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0076 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.310034:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0076 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.310047:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:0.0:1783135573.310050:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135573.310054:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0076 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.310061:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee0076 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135573.311423:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11329:x1869752786015616:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 1691us (4891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135573.311454:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:2.0:1783135573.322453:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.322530:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786015872 00000100:00100000:0.0:1783135573.322541:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786015872 00000100:00100000:0.0:1783135573.322628:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:0.0:1783135573.322639:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6580b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11329:x1869752786015872:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:0.0:1783135573.322914:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6580b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:11329:x1869752786015872:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 276us (472us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1783135573.322924:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:1.0:1783135573.358949:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809169152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135573.359024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.359315:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809169280:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359345:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.359372:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809169792:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359394:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.359410:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809170304:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359426:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.359451:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1783135573.359457:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809169408:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.359492:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809169920:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.359520:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809170432:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.359562:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809169792 00000100:00100000:1.0:1783135573.359569:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809169792 00000100:00100000:1.0:1783135573.359611:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809170304 00000100:00100000:1.0:1783135573.359613:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809170304 00000100:00100000:1.0:1783135573.359625:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809169408 00000100:00100000:1.0:1783135573.359627:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809169408 00000100:00100000:1.0:1783135573.359636:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809169920 00000100:00100000:1.0:1783135573.359638:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809169920 00000100:00100000:1.0:1783135573.359648:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809170432 00000100:00100000:1.0:1783135573.359649:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809170432 00000100:00100000:1.0:1783135573.359662:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1783135573.359669:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809169792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359722:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809169792:12345-0@lo:400:kworker.0 Request processed in 52us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.359729:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1783135573.359746:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1783135573.359751:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809170304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359771:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809170304:12345-0@lo:400:kworker.0 Request processed in 21us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.359776:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1783135573.359786:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1783135573.359791:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809169408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359823:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809169408:12345-0@lo:400:kworker.0 Request processed in 32us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.359829:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1783135573.359839:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1783135573.359844:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809169920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359865:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809169920:12345-0@lo:400:kworker.0 Request processed in 22us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.359870:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1783135573.359879:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1783135573.359883:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809170432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359902:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809170432:12345-0@lo:400:kworker.0 Request processed in 19us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.359907:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:1.0:1783135573.359923:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135573.359927:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135573.359943:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c60c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809169664:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.359989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.360008:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809170176:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.360050:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809170688:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.360081:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783135573.360108:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809169536:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.360139:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809170048:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360154:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.360165:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809170560:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360183:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135573.360205:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809169152 00000100:00100000:1.0:1783135573.360209:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809169152 00000100:00100000:1.0:1783135573.360231:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809169664 00000100:00100000:1.0:1783135573.360233:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809169664 00000100:00100000:1.0:1783135573.360244:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783135573.360249:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809169152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783135573.360288:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1783135573.360319:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809169152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.360325:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783135573.360336:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783135573.360341:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809169664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360362:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809169664:12345-0@lo:400:kworker.0 Request processed in 21us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.360373:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783135573.360389:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809170176 00000100:00100000:1.0:1783135573.360393:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809170176 00000100:00100000:1.0:1783135573.360408:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809170688 00000100:00100000:1.0:1783135573.360410:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809170688 00000100:00100000:1.0:1783135573.360424:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809170048 00000100:00100000:1.0:1783135573.360426:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809170048 00000100:00100000:1.0:1783135573.360452:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809170560 00000100:00100000:1.0:1783135573.360455:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809170560 00000100:00100000:1.0:1783135573.360470:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783135573.360475:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1869752809170176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360517:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1869752809170176:12345-0@lo:400:kworker.0 Request processed in 41us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.360522:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783135573.360532:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783135573.360537:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1869752809170688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360556:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1869752809170688:12345-0@lo:400:kworker.0 Request processed in 19us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.360560:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783135573.360569:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783135573.360573:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809170048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360591:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809170048:12345-0@lo:400:kworker.0 Request processed in 17us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.360595:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783135573.360603:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783135573.360608:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809170560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360636:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809170560:12345-0@lo:400:kworker.0 Request processed in 28us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.360641:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1783135573.360661:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135573.360663:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135573.360687:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809169408:0@lo:400:kworker.0 00010000:00080000:1.0:1783135573.360699:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438aed80 x1869752809169920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135573.360710:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809169920:0@lo:400:kworker.0 00010000:00080000:1.0:1783135573.360719:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67c652a00 x1869752809170432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135573.360727:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809170432:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360737:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809169792:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360745:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809170304:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360776:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809169536 00000100:00100000:1.0:1783135573.360779:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809169536 00000100:00100000:1.0:1783135573.360798:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1783135573.360802:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809169536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360845:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809169536:12345-0@lo:400:kworker.0 Request processed in 41us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.360851:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1783135573.360876:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809169536:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360884:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809170048:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360903:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809170560:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360913:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c60c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809169664:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360922:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809170176:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360933:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809170688:0@lo:400:kworker.0 00000100:00100000:1.0:1783135573.360946:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809169152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135573.361176:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809169280 00000100:00100000:3.0:1783135573.361181:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809169280 00000100:00100000:3.0:1783135573.361222:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1783135573.361230:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809169280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135573.361275:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809169280:12345-0@lo:400:kworker.0 Request processed in 46us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135573.361281:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1783135573.361403:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809169280:0@lo:400:kworker.0 00000100:00100000:0.0:1783135573.361642:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809170944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135573.361702:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135573.361725:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135573.361730:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809170816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135573.361748:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135573.361771:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809170944 00000100:00100000:0.0:1783135573.361775:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809170944 00000100:00100000:0.0:1783135573.361798:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809170816 00000100:00100000:0.0:1783135573.361801:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809170816 00000100:00100000:0.0:1783135573.361825:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783135573.361831:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869752809170944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135573.361853:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135573.361886:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869752809170944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135573.361892:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783135573.361904:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783135573.361910:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809170816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783135573.361928:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1783135573.361952:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809170816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135573.361958:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783135573.361979:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809171072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135573.362000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135573.362032:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809170816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135573.362042:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809170944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135573.362056:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809171072 00000100:00100000:0.0:1783135573.362059:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809171072 00000100:00100000:0.0:1783135573.362075:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783135573.362079:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809171072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135573.362116:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135573.362141:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809171072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135573.362147:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783135573.362169:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809171072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135573.362649:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135573.362659:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809171200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135573.362687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135573.362757:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809171200 00000100:00100000:2.0:1783135573.362763:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809171200 00000100:00100000:2.0:1783135573.362798:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783135573.362816:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869752809171200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135573.362828:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1783135573.362868:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1869752809171200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135573.362874:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783135573.362945:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809171200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135573.382866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135573.383524:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786016128 00000100:00100000:1.0:1783135573.383538:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786016128 00000100:00100000:1.0:1783135573.383617:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:1.0:1783135573.383628:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:10855:x1869752786016128:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135573.383657:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135573.383680:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee007d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d00 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.384010:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.384027:0:13464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf9 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.384035:0:13464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.384084:0:13464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf9 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.386411:0:13464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf9 expref: 24 pid: 6522 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135573.386434:0:13464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13464:1869752809171328:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135573.386563:0:13464:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135573.392765:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.392867:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786016256 00000100:00100000:0.0:1783135573.392879:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786016256 00010000:00010000:0.0:1783135573.392928:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf9 expref: 25 pid: 6522 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135573.392975:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:0.0:1783135573.392984:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:2401:x1869752786016256:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135573.393016:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135573.393023:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf9 expref: 25 pid: 6522 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.393037:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf9 expref: 25 pid: 6522 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.393059:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:0.0:1783135573.393065:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.393075:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.393082:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.393139:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135573.393185:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:2401:x1869752786016256:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 202us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135573.393193:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 65 00010000:00010000:1.0:1783135573.393355:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0068 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf9 expref: 24 pid: 6522 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135573.393375:0:13464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13464:1869752809171328:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135573.393536:0:13464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.393547:0:13464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.393553:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135573.393572:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1783135573.393694:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee007d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d00 expref: 25 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.393710:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d00 expref: 24 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.393732:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:1.0:1783135573.393735:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135573.393738:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51ba00, rc 0) 00000100:00100000:1.0:1783135573.393764:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:10855:x1869752786016128:12345-192.168.204.6@tcp:101:bash.0 Request processed in 10139us (10911us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1783135573.393771:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:2.0:1783135573.402271:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135573.402357:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786016384 00000100:00100000:1.0:1783135573.402371:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786016384 00000100:00100000:1.0:1783135573.402593:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 99 00000100:00100000:1.0:1783135573.402606:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:10855:x1869752786016384:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135573.402633:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135573.402654:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee0092 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d07 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.402688:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee0099 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.402704:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee0099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.402716:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee0099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.402863:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee0092 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d07 expref: 26 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.402881:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee0099 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d07 expref: 25 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.402897:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:1.0:1783135573.402900:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135573.402903:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51aa00, rc 0) 00000100:00100000:1.0:1783135573.402993:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:10855:x1869752786016384:12345-192.168.204.6@tcp:101:bash.0 Request processed in 390us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.403001:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 99 00000100:00100000:3.0:1783135573.406382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.406617:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786016640 00000100:00100000:0.0:1783135573.406628:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786016640 00000100:00100000:0.0:1783135573.406685:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 100 00000100:00100000:0.0:1783135573.406692:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:10855:x1869752786016640:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:0.0:1783135573.409327:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.409351:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.409379:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135573.409436:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1783135573.409461:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059ff2e90 reply state 00000000e456fc55 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.409476:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.409484:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:0.0:1783135573.409487:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135573.409492:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1783135573.409540:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1783135573.409665:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:10855:x1869752786016640:12345-192.168.204.6@tcp:36:bash.0 Request processed in 2968us (3291us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1783135573.409675:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 100 00000020:00080000:0.0:1783135573.409681:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1783135573.424844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135573.424975:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786016768 00000100:00100000:1.0:1783135573.424989:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786016768 00000100:00100000:1.0:1783135573.425079:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 101 00000100:00100000:1.0:1783135573.425126:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:10855:x1869752786016768:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135573.425152:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135573.425175:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee00a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d0e expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.425247:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee00a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d0e expref: 30 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.425267:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee00a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d0e expref: 30 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.425290:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:1.0:1783135573.425293:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135573.425297:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b000, rc 0) 00000100:00100000:1.0:1783135573.425734:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:10855:x1869752786016768:12345-192.168.204.6@tcp:101:bash.0 Request processed in 644us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.425743:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 101 00000100:00100000:2.0:1783135573.432731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135573.433486:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786016896 00000100:00100000:1.0:1783135573.433498:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786016896 00000100:00100000:1.0:1783135573.433585:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:1.0:1783135573.433598:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:10855:x1869752786016896:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135573.433625:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135573.433653:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee00ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d15 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135573.433686:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a487d53, atime: 0x6a487d52, ctime: 0x6a487d53, blocks: 0x8 00010000:00010000:1.0:1783135573.433717:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=477s v=(0 0) 00010000:00010000:1.0:1783135573.433721:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135573.433731:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee00ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d15 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.433753:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee00ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d15 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.433768:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a000, rc 0) 00000100:00100000:1.0:1783135573.434327:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:10855:x1869752786016896:12345-192.168.204.6@tcp:101:bash.0 Request processed in 729us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.434337:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:2.0:1783135573.445305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.447079:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786017024 00000100:00100000:0.0:1783135573.447141:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786017024 00002000:00010000:0.0:1783135573.447200:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1783135573.447207:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac543ad8380 with x1869752786017024 ext(0->18446744073709551615) 00002000:00010000:0.0:1783135573.447222:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac543ad8380. 00000100:00100000:0.0:1783135573.447264:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:0.0:1783135573.447275:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752786017024:12345-192.168.204.6@tcp:10:bash.0 00002000:00010000:0.0:1783135573.456697:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783135573.456707:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1783135571 -> 1783135573 00002000:00010000:0.0:1783135573.456721:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1783135570 -> 1783135570 00002000:00010000:0.0:1783135573.456723:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1783135571 -> 1783135573 00002000:00010000:0.0:1783135573.456725:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1783135573.456822:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786017024:12345-192.168.204.6@tcp:10:bash.0 Request processed in 9530us (11513us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783135573.456834:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00002000:00010000:0.0:1783135573.456841:0:8441:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1783135573.456845:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac543ad8380 with x1869752786017024 ext(0->18446744073709551615) 00002000:00010000:0.0:1783135573.456853:0:8441:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac543ad8380. 00000100:00100000:0.0:1783135573.543324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135573.543461:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786017152 00000100:00100000:1.0:1783135573.543477:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786017152 00000100:00100000:1.0:1783135573.543583:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:1.0:1783135573.543596:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:11344:x1869752786017152:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:1.0:1783135573.543734:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee00b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.543766:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee00b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.543782:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee00b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.543815:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee00bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.543823:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee00bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.543830:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee00bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.543948:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.543957:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.543964:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135573.544162:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544180:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee00b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544186:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee00b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544205:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee00b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544212:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135573.544217:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee00b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544226:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee00b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544243:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:1.0:1783135573.544247:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135573.544253:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee00b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544259:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee00b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544276:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee00bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544282:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee00bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544288:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee00bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544293:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135573.544296:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee00bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544312:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee00bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544320:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac65800cd00) 00010000:00010000:1.0:1783135573.544322:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135573.544326:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee00bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544331:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee00bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544346:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544352:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544358:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544364:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135573.544367:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544373:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544380:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:1.0:1783135573.544383:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135573.544387:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.544402:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee00c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135573.544523:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:11344:x1869752786017152:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 928us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.544533:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:0.0:1783135573.602423:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135573.602716:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786017408 00000100:00100000:2.0:1783135573.602730:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786017408 00000100:00100000:2.0:1783135573.602819:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 103 00000100:00100000:2.0:1783135573.602840:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:11347:x1869752786017408:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135573.602871:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135573.603057:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee00ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d1c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.603334:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00d1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.603354:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.603387:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.603407:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee00d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.603415:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee00d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.603422:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee00d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.603790:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee00df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.603812:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee00df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.603821:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee00df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135573.603967:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783135573.604336:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00d1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604345:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00d1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604353:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604360:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135573.604379:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00d1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604387:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00d1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604403:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135573.604406:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135573.604412:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604419:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604436:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee00d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604443:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee00d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604449:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee00d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604454:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135573.604457:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee00d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604463:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee00d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604471:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac67c558e00) 00010000:00010000:2.0:1783135573.604474:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135573.604483:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee00d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604489:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee00d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604626:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee00ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d1c expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604645:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee00df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d1c expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.604653:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:2.0:1783135573.604655:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783135573.604658:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908800, rc 0) 00000100:00100000:2.0:1783135573.604915:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:11347:x1869752786017408:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 2083us (2503us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1783135573.604925:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 103 00000100:00100000:2.0:1783135573.612296:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135573.612420:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786017536 00000100:00100000:3.0:1783135573.612436:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786017536 00000100:00100000:3.0:1783135573.612794:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:3.0:1783135573.612823:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:11347:x1869752786017536:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:3.0:1783135573.612955:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.612979:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d00 expref: 32 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.612991:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.613076:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d00 expref: 32 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.613333:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d00 expref: 32 pid: 13464 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135573.613357:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809171456:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135573.613490:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135573.618737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135573.618880:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809171456:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135573.618920:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135573.619000:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786017792 00000100:00100000:1.0:1783135573.619009:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786017792 00000100:00100000:1.0:1783135573.619115:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:1.0:1783135573.619126:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+33:9943:x1869752786017792:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000001:00080000:1.0:1783135573.619524:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967373 00000100:00100000:1.0:1783135573.619721:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:9943:x1869752786017792:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 595us (1001us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1783135573.619732:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000020:00080000:1.0:1783135573.619739:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783135573.622991:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135573.623333:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786017920 00000100:00100000:1.0:1783135573.623345:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786017920 00010000:00010000:1.0:1783135573.623478:0:10345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d00 expref: 35 pid: 13464 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135573.623534:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:1.0:1783135573.623546:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:2399:x1869752786017920:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135573.623568:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135573.623576:0:10345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d00 expref: 35 pid: 13464 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.623788:0:10345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d00 expref: 35 pid: 13464 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.623830:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee0084 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d00 expref: 35 pid: 13464 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.623927:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:1.0:1783135573.623935:0:10345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.623949:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.623958:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.623994:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135573.624178:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+34:2399:x1869752786017920:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 633us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.624188:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 66 00010000:00010000:3.0:1783135573.624268:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.624282:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.624337:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.624344:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.624362:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.624369:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135573.624375:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.624398:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.624409:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:3.0:1783135573.624412:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135573.624416:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.624423:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee00ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135573.624476:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+33:11347:x1869752786017536:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 11658us (12195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135573.624485:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:2.0:1783135573.628410:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.628585:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786018176 00000100:00100000:0.0:1783135573.628600:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786018176 00000100:00100000:0.0:1783135573.628907:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1783135573.628923:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+33:11347:x1869752786018176:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:0.0:1783135573.629442:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+34:11347:x1869752786018176:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 521us (1055us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1783135573.629452:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1783135573.726365:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135573.727346:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786018432 00000100:00100000:2.0:1783135573.727365:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786018432 00000100:00100000:2.0:1783135573.727460:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 105 00000100:00100000:2.0:1783135573.727473:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+34:11358:x1869752786018432:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:2.0:1783135573.727512:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135573.727543:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d23 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.727665:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee00fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.727960:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee00fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.727977:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee00fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728000:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0102 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728008:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728014:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728222:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0109 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728232:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0109 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728240:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0109 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135573.728253:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1783135573.728366:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee00fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728374:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee00fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728381:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee00fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728398:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135573.728404:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee00fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728414:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee00fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728430:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135573.728433:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135573.728438:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee00fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728446:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee00fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728464:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728470:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0102 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728477:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0102 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728482:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135573.728484:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0102 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728490:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0102 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728509:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac67c558e00) 00010000:00010000:2.0:1783135573.728511:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135573.728514:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0102 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728521:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0102 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728579:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee00f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d23 expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728596:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0109 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d23 expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.728603:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:2.0:1783135573.728605:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135573.728608:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908c00, rc 0) 00000100:00100000:2.0:1783135573.729528:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+36:11358:x1869752786018432:12345-192.168.204.6@tcp:101:cat.0 Request processed in 2048us (3188us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1783135573.729541:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 105 00000100:00100000:2.0:1783135573.740409:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135573.741587:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786018688 00000100:00100000:1.0:1783135573.741604:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786018688 00000100:00100000:1.0:1783135573.742122:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:1.0:1783135573.742137:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+36:11358:x1869752786018688:12345-192.168.204.6@tcp:35:cat.0 00000100:00100000:1.0:1783135573.742596:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:11358:x1869752786018688:12345-192.168.204.6@tcp:35:cat.0 Request processed in 460us (2198us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1783135573.742613:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:1.0:1783135573.780459:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135573.782947:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786018944 00000100:00100000:2.0:1783135573.782972:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786018944 00000100:00100000:0.0:1783135573.783197:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 106 00000100:00100000:0.0:1783135573.783213:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:11359:x1869752786018944:12345-192.168.204.6@tcp:36:rm.0 00010000:00010000:0.0:1783135573.783306:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1783135573.783343:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee00a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d0e expref: 37 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783413:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0109 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d23 expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783429:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee00df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d1c expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783441:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee0099 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d07 expref: 34 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783453:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:0.0:1783135573.783460:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135573.783492:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0117 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783516:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0117 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783527:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0117 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783547:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783555:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783561:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783702:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0125 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783711:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0125 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.783719:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0125 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135573.784426:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1783135573.784441:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 477577353049ns, next at 478577350239ns, rc = 0 00010000:00010000:0.0:1783135573.784522:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784544:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784741:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784751:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784757:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784764:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784793:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135573.784830:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0125 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784853:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0125 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784859:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0125 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784866:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135573.784871:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0125 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784880:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0125 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784896:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:0.0:1783135573.784900:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783135573.784905:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0125 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.784907:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135573.784926:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784927:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0125 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.784958:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135573.784978:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.784979:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0117 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.785000:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.785001:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0117 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.785034:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0117 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.785041:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:0.0:1783135573.785042:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135573.785046:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783135573.785051:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.785059:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0117 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.785063:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee012c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.785133:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0117 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.785148:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135573.785151:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135573.785155:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0117 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.785162:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0117 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135573.785174:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003aa9041d reply state 00000000a82820a6 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.785189:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.785200:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135573.785200:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424ce900) 00010000:00010000:2.0:1783135573.785208:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135573.785209:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135573.785214:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135573.785216:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135573.785322:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:11359:x1869752786018944:12345-192.168.204.6@tcp:36:rm.0 Request processed in 2109us (4877us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1783135573.785334:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 106 00010000:00010000:0.0:1783135573.870586:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135573.871893:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.876901:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786019200 00000100:00100000:0.0:1783135573.876933:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786019200 00000100:00100000:0.0:1783135573.877145:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 107 00000100:00100000:0.0:1783135573.877165:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:11365:x1869752786019200:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1783135573.877225:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135573.877577:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0133 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d2a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.877738:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee013a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.877757:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee013a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.877769:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee013a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.877781:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.877788:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.877793:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135573.880222:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1783135573.881325:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.881348:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.881360:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.882958:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee013a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.882966:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee013a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.882973:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee013a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.882979:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135573.882984:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee013a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.882991:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee013a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.883006:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135573.883009:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135573.883013:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee013a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.883019:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee013a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135573.883036:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a3a9fb45 reply state 000000004866f4e9 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.883049:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.883057:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424ce900) 00010000:00010000:0.0:1783135573.883065:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135573.883069:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783135573.883154:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0133 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d2a expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.883172:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d2a expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135573.883182:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:0.0:1783135573.883185:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135573.883188:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d600, rc 0) 00000100:00100000:0.0:1783135573.883272:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:11365:x1869752786019200:12345-192.168.204.6@tcp:101:bash.0 Request processed in 6116us (11387us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1783135573.883282:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 107 00000100:00100000:0.0:1783135573.891212:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135573.896170:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786019328 00000100:00100000:1.0:1783135573.896200:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786019328 00000100:00100000:1.0:1783135573.896333:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:1.0:1783135573.896349:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2398:x1869752786019328:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135573.896387:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135573.896422:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0273126/0xf7de4ef628ee0156 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d31 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135573.896466:0:8620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135573.896502:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=477s v=(0 0) 00010000:00010000:1.0:1783135573.896508:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135573.896521:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0273126/0xf7de4ef628ee0156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d31 expref: 8 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.896550:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0273126/0xf7de4ef628ee0156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d31 expref: 8 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135573.896570:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a200, rc 0) 00000100:00100000:1.0:1783135573.896706:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2398:x1869752786019328:12345-192.168.204.6@tcp:101:bash.0 Request processed in 360us (5508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135573.896714:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:1.0:1783135573.925921:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135573.926075:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786019456 00000100:00100000:2.0:1783135573.926247:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786019456 00000100:00100000:2.0:1783135573.926363:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:2.0:1783135573.926378:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:11365:x1869752786019456:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1783135573.926404:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135573.926431:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d38 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.926474:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0273126/0xf7de4ef628ee0156 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d31 expref: 9 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.926486:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135573.926490:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135573.926515:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 9 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.926565:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0273126/0xf7de4ef628ee0156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d31 expref: 9 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.926580:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0273126/0xf7de4ef628ee0156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d31 expref: 9 pid: 8620 timeout: 577 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135573.926597:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543797b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1869752809171584:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135573.926734:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135573.932131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.937048:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786019584 00000100:00100000:0.0:1783135573.937075:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786019584 00010000:00010000:3.0:1783135573.937316:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0273126/0xf7de4ef628ee0156 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d31 expref: 10 pid: 8620 timeout: 577 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135573.937397:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:2.0:1783135573.937399:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543797b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1869752809171584:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135573.937408:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2400:x1869752786019584:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135573.937429:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135573.937440:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 10 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.937455:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0273126/0xf7de4ef628ee0156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d31 expref: 10 pid: 8620 timeout: 577 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135573.937461:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909800, rc 0) 00010000:00010000:3.0:1783135573.937469:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0273126/0xf7de4ef628ee0156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d31 expref: 10 pid: 8620 timeout: 577 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.937526:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0273126/0xf7de4ef628ee0156 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d31 expref: 10 pid: 8620 timeout: 577 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.937546:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783135573.937547:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:11365:x1869752786019456:12345-192.168.204.6@tcp:101:bash.0 Request processed in 11173us (11642us total) trans 0 rc 0/0 00010000:00010000:3.0:1783135573.937550:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783135573.937556:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00010000:00010000:3.0:1783135573.937559:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 9 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.937570:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135573.937614:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135573.937643:0:6509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6509:1869752809171712:192.168.204.6@tcp:105: 00000100:00100000:3.0:1783135573.937713:0:6509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072180 going to sleep for 11 seconds 00000100:00100000:3.0:1783135573.945313:0:6509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6509:1869752809171712:192.168.204.6@tcp:105: 00010000:00010000:3.0:1783135573.945369:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135573.945543:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786019584:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 8134us (13458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135573.945559:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:3.0:1783135573.946069:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135573.946525:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786019840 00000100:00100000:0.0:1783135573.946537:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786019840 00000100:00100000:0.0:1783135573.946645:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:0.0:1783135573.946657:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:11365:x1869752786019840:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:0.0:1783135573.947140:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+39:11365:x1869752786019840:12345-192.168.204.6@tcp:35:bash.0 Request processed in 483us (1072us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1783135573.947149:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:1.0:1783135574.217982:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135574.218353:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786019968 00000100:00100000:2.0:1783135574.218372:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786019968 00000100:00100000:2.0:1783135574.218492:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 108 00000100:00100000:2.0:1783135574.218508:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+39:11381:x1869752786019968:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135574.218548:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135574.218588:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0164 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d3f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.218753:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee016b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.218773:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee016b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.218799:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee016b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135574.219255:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1783135574.219262:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135574.219296:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee016b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.219332:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0164 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d3f expref: 41 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.219359:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee016b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d3f expref: 40 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.219369:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135574.219373:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135574.219377:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908e00, rc 0) 00000100:00080000:1.0:1783135574.219549:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135574.219594:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+40:11381:x1869752786019968:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1090us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135574.219604:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 108 00000100:00100000:3.0:1783135574.227687:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.227988:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786020224 00000100:00100000:0.0:1783135574.228004:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786020224 00000100:00100000:0.0:1783135574.228140:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 109 00000100:00100000:0.0:1783135574.228153:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+40:11381:x1869752786020224:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135574.228204:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135574.228233:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0172 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d46 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.228389:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0179 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.228406:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0179 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.228420:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0179 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135574.228435:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783135574.228605:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0172 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d46 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.228653:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0179 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d46 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.228663:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:0.0:1783135574.228666:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135574.228670:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c600, rc 0) 00000100:00100000:0.0:1783135574.228776:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+42:11381:x1869752786020224:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 626us (1113us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1783135574.228785:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 109 00000100:00100000:3.0:1783135574.236186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.236337:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786020352 00000100:00100000:0.0:1783135574.236352:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786020352 00000100:00100000:0.0:1783135574.236451:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:0.0:1783135574.236473:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+42:2398:x1869752786020352:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135574.236498:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135574.236532:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee0179 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d46 expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.236559:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:0.0:1783135574.236565:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135574.236647:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+41:2398:x1869752786020352:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 177us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135574.236656:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:3.0:1783135574.239722:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.243180:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786020608 00000100:00100000:0.0:1783135574.243207:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786020608 00000100:00100000:0.0:1783135574.243364:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 110 00000100:00100000:0.0:1783135574.243379:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+41:11381:x1869752786020608:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135574.243417:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135574.243444:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0187 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d4d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.243604:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee018e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.243622:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee018e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.243638:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee018e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135574.243668:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783135574.245229:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0187 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d4d expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.245268:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee018e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d4d expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.245279:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:0.0:1783135574.245283:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783135574.245287:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c200, rc 0) 00000100:00100000:0.0:1783135574.245396:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:11381:x1869752786020608:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 2021us (5689us total) trans 4294967382 rc 0/0 00000100:00100000:0.0:1783135574.245408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 110 00000100:00100000:3.0:1783135574.256448:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135574.256551:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786020736 00000100:00100000:2.0:1783135574.256568:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786020736 00000100:00100000:2.0:1783135574.257522:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:2.0:1783135574.257541:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786020736:12345-192.168.204.6@tcp:1:lfs.0 00010000:00010000:2.0:1783135574.257612:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.257639:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.257648:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783135574.257653:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135574.257658:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.257717:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.257734:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 8 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135574.257753:0:8435:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543797b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1869752809171840:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135574.257908:0:8435:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135574.260887:0:8435:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543797b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1869752809171840:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135574.260930:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135574.262213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135574.263078:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786020864 00000100:00100000:2.0:1783135574.263133:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786020864 00002000:00100000:2.0:1783135574.263209:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8ac544193480 x1869752786020864/t0(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:745/0 lens 504/0 e 0 to 0 dl 1783135585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135574.263222:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac544193480 with x1869752786020864 ext(0->8) 00010000:00010000:2.0:1783135574.263253:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 9 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.263274:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 9 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135574.263283:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ac544193480 00000100:00100000:2.0:1783135574.263314:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:2.0:1783135574.263326:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2401:x1869752786020864:12345-192.168.204.6@tcp:4:lfs.0 00000100:00080000:1.0:1783135574.267841:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135574.268403:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544193480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:2401:x1869752786020864:12345-192.168.204.6@tcp:4:lfs.0 Request processed in 5065us (6189us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783135574.268420:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00002000:00100000:2.0:1783135574.268442:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8ac544193480 x1869752786020864/t4294967303(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:745/0 lens 504/448 e 0 to 0 dl 1783135585 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135574.268454:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac544193480 with x1869752786020864 ext(0->8) 00010000:00010000:2.0:1783135574.268467:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 11 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.268494:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 11 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135574.268502:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ac544193480 00000100:00100000:2.0:1783135574.281847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.282154:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786020992 00000100:00100000:0.0:1783135574.282172:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786020992 00010000:00010000:0.0:1783135574.282233:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 11 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135574.282297:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:0.0:1783135574.282309:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6618a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:2398:x1869752786020992:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135574.282332:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783135574.282357:0:10346:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783135574.282360:0:10346:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1783135574 00002000:00010000:0.0:1783135574.282363:0:10346:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1783135574 00002000:00010000:0.0:1783135574.282403:0:10346:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1783135574 00002000:00010000:0.0:1783135574.282405:0:10346:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783135574.282413:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 11 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.282429:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 11 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.282464:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad091580/0xf7de4ef628ee015d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d38 expref: 11 pid: 8438 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.282486:0:10346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135574.282491:0:10346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135574.282498:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.282509:0:10346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.282551:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135574.282634:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6618a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2398:x1869752786020992:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 326us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135574.282650:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 68 00010000:00010000:2.0:1783135574.283834:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.283879:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.283915:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.283923:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.283933:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.283943:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908800 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135574.283949:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.283958:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.283981:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.283988:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f2496c7/0xf7de4ef628ee019c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135574.284184:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2400:x1869752786020736:12345-192.168.204.6@tcp:1:lfs.0 Request processed in 26646us (27748us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135574.284195:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:2.0:1783135574.291308:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135574.291726:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786021248 00000100:00100000:1.0:1783135574.291767:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786021248 00000100:00100000:1.0:1783135574.291875:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:1.0:1783135574.291888:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6580b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:11381:x1869752786021248:12345-192.168.204.6@tcp:35:lfs.0 00000004:00010000:1.0:1783135574.291986:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee018e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d4d expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135574.292297:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1783135574.292333:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1783135574.292815:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:1.0:1783135574.292874:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.292895:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d2a expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.292906:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.292952:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d2a expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.292971:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d2a expref: 47 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135574.292988:0:6525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6525:1869752809171968:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135574.301925:0:6525:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135574.303190:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135574.303315:0:6525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6525:1869752809171968:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135574.303350:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135574.303432:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786021376 00000100:00100000:1.0:1783135574.303442:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786021376 00010000:00010000:1.0:1783135574.303492:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d2a expref: 48 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135574.303558:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:1.0:1783135574.303568:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+48:2400:x1869752786021376:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135574.303587:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135574.303595:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d2a expref: 48 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.303608:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d2a expref: 48 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.303637:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0148 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d2a expref: 48 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.303668:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:1.0:1783135574.303808:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.303832:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.303841:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.303875:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135574.303954:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+47:2400:x1869752786021376:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 385us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135574.303962:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 69 00010000:00010000:2.0:1783135574.304135:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.304143:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135574.304311:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:2.0:1783135574.304446:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1783135574.304578:0:6525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543795c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869752809172096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783135574.304884:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135574.304923:0:6525:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308af00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135574.306064:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809172096 00000100:00100000:1.0:1783135574.306110:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809172096 00000100:00100000:1.0:1783135574.306191:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783135574.306204:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6525:x1869752809172096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783135574.306351:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6525:x1869752809172096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 149us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135574.306359:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783135574.306422:0:6525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543795c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869752809172096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783135574.307999:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:0.0:1783135574.315343:0:6525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869752809172224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783135574.315465:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135574.315570:0:6525:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c481540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135574.322322:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809172224 00000100:00100000:2.0:1783135574.322343:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809172224 00000100:00100000:2.0:1783135574.322450:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783135574.322464:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6525:x1869752809172224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783135574.322769:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6525:x1869752809172224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 307us (7304us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783135574.322778:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783135574.323444:0:6525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1869752809172224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783135574.323554:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1783135574.323648:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.323660:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.323668:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.323682:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135574.323687:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.323696:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.323718:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:0.0:1783135574.323721:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783135574.323726:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.323733:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee01a3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135574.323909:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783135574.323994:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1783135574.324008:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 478116919239ns, next at 479116916586ns, rc = 0 00000001:00080000:0.0:1783135574.324015:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:0.0:1783135574.324055:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:0.0:1783135574.324058:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783135574.324067:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee018e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d4d expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135574.324381:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6580b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+50:11381:x1869752786021248:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 32494us (33092us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1783135574.324393:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 26 00000020:00080000:0.0:1783135574.324399:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783135574.333019:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135574.333145:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786021504 00000100:00100000:2.0:1783135574.333158:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786021504 00000100:00100000:2.0:1783135574.333256:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 111 00000100:00100000:2.0:1783135574.333268:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+50:11381:x1869752786021504:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135574.333305:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135574.333338:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee01aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d54 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.333417:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee01aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d54 expref: 51 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.333436:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee01aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d54 expref: 51 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.333460:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:2.0:1783135574.333463:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135574.333468:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908800, rc 0) 00000100:00100000:2.0:1783135574.345182:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+51:11381:x1869752786021504:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 11894us (12156us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135574.345201:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 111 00000100:00100000:3.0:1783135574.352226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.352389:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786021760 00000100:00100000:0.0:1783135574.352403:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786021760 00000100:00100000:0.0:1783135574.352481:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:0.0:1783135574.352495:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+51:11381:x1869752786021760:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:0.0:1783135574.352899:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:11381:x1869752786021760:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 405us (689us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1783135574.352908:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:0.0:1783135574.453774:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135574.460010:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786021888 00000100:00100000:1.0:1783135574.460029:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786021888 00000100:00100000:1.0:1783135574.460177:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:1.0:1783135574.460191:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:11391:x1869752786021888:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:1.0:1783135574.460288:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460309:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460322:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460333:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee01b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460341:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee01b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460347:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee01b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460447:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460462:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460469:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135574.460515:0:13464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460528:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460535:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01b1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460542:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460548:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135574.460553:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460560:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460571:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:1.0:1783135574.460574:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135574.460577:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460588:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460602:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee01b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460608:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee01b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460614:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee01b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460620:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51bc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135574.460622:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee01b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460627:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee01b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460634:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424ce900) 00010000:00010000:1.0:1783135574.460636:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135574.460639:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee01b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460645:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee01b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460663:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460669:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460680:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460685:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135574.460688:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460693:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460700:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:1.0:1783135574.460702:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135574.460705:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.460710:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135574.460824:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:11391:x1869752786021888:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 628us (7057us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135574.460833:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:3.0:1783135574.505398:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.505606:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786022144 00000100:00100000:0.0:1783135574.505629:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786022144 00000100:00100000:0.0:1783135574.505725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 113 00000100:00100000:0.0:1783135574.505739:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:11394:x1869752786022144:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135574.505773:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135574.505815:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee01c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d5b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.505937:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee01cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.505973:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee01cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.505989:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee01cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506004:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee01d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506013:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee01d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506020:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee01d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506476:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506488:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506497:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135574.506511:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783135574.506612:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee01cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506621:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee01cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506628:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee01cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506647:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135574.506653:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee01cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506662:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee01cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506745:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135574.506749:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135574.506755:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee01cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506762:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee01cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506779:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee01d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506795:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee01d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506801:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee01d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506806:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135574.506808:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee01d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506928:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee01d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506952:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424ce900) 00010000:00010000:0.0:1783135574.506955:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135574.506958:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee01d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.506964:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee01d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.507023:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee01c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d5b expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.507039:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d5b expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.507047:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135574.507049:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135574.507053:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d600, rc 0) 00000100:00100000:0.0:1783135574.507357:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:11394:x1869752786022144:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1619us (1975us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1783135574.507368:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 113 00000100:00100000:2.0:1783135574.513666:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135574.513881:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786022272 00000100:00100000:1.0:1783135574.513898:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786022272 00000100:00100000:1.0:1783135574.513997:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 114 00000100:00100000:1.0:1783135574.514010:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:11394:x1869752786022272:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:1.0:1783135574.514135:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.514158:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.514194:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.514321:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.514329:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.514338:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.514344:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135574.514350:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.514358:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.514373:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:1.0:1783135574.514376:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135574.514386:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.514392:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135574.514502:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:11394:x1869752786022272:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 494us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135574.514511:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 114 00000100:00100000:2.0:1783135574.518035:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.518202:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786022528 00000100:00100000:0.0:1783135574.518217:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786022528 00000100:00100000:0.0:1783135574.518304:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:0.0:1783135574.518318:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:11394:x1869752786022528:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:0.0:1783135574.518687:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+55:11394:x1869752786022528:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 369us (665us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1783135574.518696:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:3.0:1783135574.607792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135574.608318:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786022784 00000100:00100000:1.0:1783135574.608355:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786022784 00000100:00100000:1.0:1783135574.608569:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 115 00000100:00100000:1.0:1783135574.608581:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+55:11404:x1869752786022784:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135574.609115:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135574.609121:0:8461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783135574.609169:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee016b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d3f expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.609204:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:1.0:1783135574.609211:0:8461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135574.609234:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d62 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.613320:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.613358:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d5b expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.613368:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.613425:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d5b expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.613447:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d5b expref: 55 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135574.613467:0:8461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809172352:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135574.613717:0:8461:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135574.622161:0:8461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809172352:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135574.622202:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135574.624276:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.624402:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786022912 00000100:00100000:0.0:1783135574.624416:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786022912 00010000:00010000:0.0:1783135574.624476:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d5b expref: 56 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135574.624585:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:0.0:1783135574.624598:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+56:2401:x1869752786022912:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135574.624631:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135574.624640:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d5b expref: 56 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.624656:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d5b expref: 56 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.624696:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee01db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d5b expref: 56 pid: 6522 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.624717:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135574.624724:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.624735:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.624744:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.624795:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135574.624963:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.624973:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135574.624997:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783135574.625210:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee01f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d62 expref: 57 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.625231:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d62 expref: 56 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.625239:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:3.0:1783135574.625242:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135574.625244:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b400, rc 0) 00000100:00100000:0.0:1783135574.625473:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+56:2401:x1869752786022912:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 876us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135574.625502:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:3.0:1783135574.627363:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+55:11404:x1869752786022784:12345-192.168.204.6@tcp:101:bash.0 Request processed in 18767us (19583us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1783135574.627404:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 115 00000100:00100000:1.0:1783135574.633436:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.633552:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786023040 00000100:00100000:0.0:1783135574.633568:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786023040 00000100:00100000:0.0:1783135574.633763:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 116 00000100:00100000:0.0:1783135574.633777:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+55:11404:x1869752786023040:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1783135574.633835:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135574.633867:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0205 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d69 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.633916:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.633934:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.633950:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.634180:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee0205 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d69 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.634207:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d69 expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.634219:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135574.634223:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135574.634228:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c200, rc 0) 00000100:00100000:0.0:1783135574.634319:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+56:11404:x1869752786023040:12345-192.168.204.6@tcp:101:bash.0 Request processed in 545us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135574.634336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 116 00000100:00100000:1.0:1783135574.639066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135574.639500:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786023296 00000100:00100000:2.0:1783135574.639517:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786023296 00000100:00100000:2.0:1783135574.639601:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00100000:2.0:1783135574.639613:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+56:11404:x1869752786023296:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:2.0:1783135574.640380:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.640429:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.640445:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135574.640505:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:2.0:1783135574.640532:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000579fdcae reply state 000000004b3e5833 transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.640547:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.640555:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:2.0:1783135574.640559:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135574.640564:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135574.640709:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:11404:x1869752786023296:12345-192.168.204.6@tcp:36:bash.0 Request processed in 1094us (1656us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1783135574.640719:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 117 00000020:00080000:2.0:1783135574.640726:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783135574.644219:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135574.645369:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786023424 00000100:00100000:3.0:1783135574.645392:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786023424 00000100:00100000:3.0:1783135574.645526:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 118 00000100:00100000:3.0:1783135574.645541:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:11404:x1869752786023424:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1783135574.645575:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135574.645604:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee021a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d70 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.645745:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.645764:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d62 expref: 60 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.645775:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.646012:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d62 expref: 60 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.646028:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d62 expref: 60 pid: 8461 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135574.646043:0:8461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544191880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809172480:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135574.646212:0:8461:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135574.649334:0:8461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544191880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809172480:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135574.649380:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135574.651167:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.651389:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786023552 00000100:00100000:0.0:1783135574.651401:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786023552 00010000:00010000:0.0:1783135574.651459:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d62 expref: 61 pid: 8461 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135574.651511:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 71 00000100:00100000:0.0:1783135574.651525:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:2400:x1869752786023552:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135574.651545:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135574.651554:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d62 expref: 61 pid: 8461 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.651570:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d62 expref: 61 pid: 8461 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.651599:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee01f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d62 expref: 61 pid: 8461 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.651632:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135574.651639:0:10346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.651649:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.651679:0:10346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.651715:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135574.651976:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+60:2400:x1869752786023552:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 453us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135574.651985:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 71 00010000:00010000:3.0:1783135574.652204:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.652222:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135574.652303:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783135574.652309:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135574.652336:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.652375:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee021a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d70 expref: 60 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.652397:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d70 expref: 59 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135574.652404:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:3.0:1783135574.652407:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135574.652410:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640031200, rc 0) 00000100:00100000:3.0:1783135574.652445:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:11404:x1869752786023424:12345-192.168.204.6@tcp:101:bash.0 Request processed in 6909us (8247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135574.652453:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 118 00000100:00100000:3.0:1783135574.664152:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.664271:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786023808 00000100:00100000:0.0:1783135574.664285:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786023808 00000100:00100000:0.0:1783135574.664373:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:0.0:1783135574.664386:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:11404:x1869752786023808:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:0.0:1783135574.665408:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+60:11404:x1869752786023808:12345-192.168.204.6@tcp:35:bash.0 Request processed in 1017us (1314us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1783135574.665423:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:2.0:1783135574.772243:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.772991:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786023936 00000100:00100000:0.0:1783135574.773012:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786023936 00000100:00100000:0.0:1783135574.773207:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 119 00000100:00100000:0.0:1783135574.773220:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+60:11410:x1869752786023936:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135574.773256:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135574.773284:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d77 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.773378:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee022f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.773396:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee022f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.773438:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee022f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135574.773501:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1783135574.773506:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135574.773533:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee022f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.773565:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d77 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.773591:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee022f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d77 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.773601:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:0.0:1783135574.773604:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135574.773609:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c600, rc 0) 00000100:00100000:0.0:1783135574.773713:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:11410:x1869752786023936:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 495us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135574.773722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 119 00000100:00100000:3.0:1783135574.788277:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135574.788555:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786024064 00000100:00100000:2.0:1783135574.788570:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786024064 00000100:00100000:2.0:1783135574.788658:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 120 00000100:00100000:2.0:1783135574.788687:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:11410:x1869752786024064:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135574.788714:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135574.788742:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee0236 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d7e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.788895:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee023d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.788916:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee023d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.788934:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee023d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.788951:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0244 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.788958:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.788965:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789073:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789083:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789134:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135574.789195:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783135574.789201:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135574.789242:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789267:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789278:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee023d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789285:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee023d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789293:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee023d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789300:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135574.789305:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee023d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789313:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee023d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789327:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135574.789330:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135574.789335:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee023d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789342:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee023d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789359:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789365:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0244 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789377:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0244 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789383:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135574.789386:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0244 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789394:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0244 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789402:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424ce900) 00010000:00010000:2.0:1783135574.789404:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135574.789408:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0244 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789413:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0244 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789448:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee0236 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d7e expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789463:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d7e expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.789471:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:2.0:1783135574.789473:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135574.789475:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909600, rc 0) 00000100:00100000:2.0:1783135574.789562:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:11410:x1869752786024064:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 885us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135574.789581:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 120 00000100:00100000:3.0:1783135574.799255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135574.801949:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.803439:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786024320 00000100:00100000:0.0:1783135574.803460:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786024320 00000100:00100000:2.0:1783135574.803687:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 121 00000100:00100000:2.0:1783135574.803702:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:11410:x1869752786024320:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135574.803731:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135574.803760:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee0252 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d85 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.804181:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.804203:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d70 expref: 63 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.804212:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d7e expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.804221:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.804269:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d7e expref: 63 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.804286:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d7e expref: 63 pid: 6524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135574.804303:0:8461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809172608:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135574.804448:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d70 expref: 63 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.804480:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d70 expref: 63 pid: 8461 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135574.804491:0:8461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809172736:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135574.804522:0:8461:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135574.805448:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786024448 00000100:00100000:1.0:1783135574.805470:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786024448 00010000:00010000:1.0:1783135574.805530:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d7e expref: 64 pid: 6524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135574.805585:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:1.0:1783135574.805595:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+64:2400:x1869752786024448:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135574.805613:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135574.805620:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d7e expref: 64 pid: 6524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.805633:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d7e expref: 64 pid: 6524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.805660:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:1.0:1783135574.805665:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.805737:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135574.805746:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135574.805874:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544190000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+64:2400:x1869752786024448:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 278us (3939us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135574.805904:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:3.0:1783135574.809971:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.811230:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786024576 00000100:00100000:0.0:1783135574.811252:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786024576 00010000:00010000:0.0:1783135574.811331:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d70 expref: 64 pid: 8461 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135574.811395:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:0.0:1783135574.811408:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+64:2401:x1869752786024576:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135574.811460:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135574.811470:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d70 expref: 64 pid: 8461 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.811486:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d70 expref: 64 pid: 8461 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.811518:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135574.811525:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.811537:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.811546:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.811581:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135574.812025:0:8461:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.6@tcp) returned -22 from blocking AST (req@0000000013a6a45a x1869752809172608) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d7e expref: 64 pid: 6524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.812053:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee024b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d7e expref: 64 pid: 6524 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135574.812081:0:8461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809172608:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135574.812163:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0221 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d70 expref: 63 pid: 8461 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135574.812184:0:8461:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8461:1869752809172736:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135574.812223:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:2.0:1783135574.812234:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.812248:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.812260:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135574.812319:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00100000:0.0:1783135574.812499:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544190a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:2401:x1869752786024576:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 1089us (2540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135574.813593:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 73 00010000:00010000:2.0:1783135574.814481:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee0252 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d85 expref: 63 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.814513:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d85 expref: 62 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135574.814524:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:2.0:1783135574.814526:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135574.814531:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909400, rc 0) 00000100:00100000:2.0:1783135574.814615:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:11410:x1869752786024320:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 10917us (15376us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1783135574.814624:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 121 00000100:00100000:3.0:1783135574.824354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.824759:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786024832 00000100:00100000:0.0:1783135574.824773:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786024832 00000100:00100000:0.0:1783135574.824888:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:0.0:1783135574.824899:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:11410:x1869752786024832:12345-192.168.204.6@tcp:103:lfs.0 00010000:00010000:0.0:1783135574.824923:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135574.824954:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee01aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d54 expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.825004:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135574.825011:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135574.825162:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:11410:x1869752786024832:12345-192.168.204.6@tcp:103:lfs.0 Request processed in 263us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135574.825172:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:1.0:1783135574.829034:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.829486:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786024960 00000100:00100000:0.0:1783135574.829501:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786024960 00000100:00100000:0.0:1783135574.829641:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 122 00000100:00100000:0.0:1783135574.829654:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:11410:x1869752786024960:12345-192.168.204.6@tcp:58:lfs.0 00010000:00010000:0.0:1783135574.830225:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.830253:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.830269:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135574.830416:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1783135574.830605:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:11410:x1869752786024960:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 951us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135574.830626:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 122 00000100:00100000:3.0:1783135574.833536:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135574.833961:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786025088 00000100:00100000:0.0:1783135574.833975:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786025088 00000100:00100000:0.0:1783135574.834047:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00100000:0.0:1783135574.834058:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:11410:x1869752786025088:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135574.834083:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135574.834153:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee026e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d8c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.834227:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.834238:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee026e lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d8c expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.834261:0:6522:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.834278:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee026e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d8c expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.834294:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135574.834297:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135574.834302:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee026e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d8c expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135574.834310:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d600, rc 0) 00000100:00100000:0.0:1783135574.834382:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:11410:x1869752786025088:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 325us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135574.834391:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 123 00010000:00010000:3.0:1783135574.894458:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135575.091693:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135575.091709:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135575.091795:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1783135575.091816:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135575.092028:0:13815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809172864:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135575.092265:0:13815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135575.099240:0:13815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809172864:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135575.100769:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.101406:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786025216 00000100:00100000:2.0:1783135575.101423:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786025216 00000100:00100000:2.0:1783135575.101752:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 124 00000100:00100000:2.0:1783135575.101766:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:11411:x1869752786025216:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783135575.105193:0:8461:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783135575.105423:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:11411:x1869752786025216:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 3649us (4655us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135575.105447:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 124 00000100:00100000:3.0:1783135575.124351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135575.133949:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786025344 00000100:00100000:0.0:1783135575.133972:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786025344 00000100:00100000:0.0:1783135575.134085:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 125 00000100:00100000:0.0:1783135575.134117:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:11411:x1869752786025344:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783135575.134221:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0275 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134260:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134274:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134291:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee027c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134298:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee027c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134304:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee027c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134336:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134347:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134354:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135575.134418:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783135575.134423:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135575.134438:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134450:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134467:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0275 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134474:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0275 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134480:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.134485:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0275 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134494:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0275 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134509:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:0.0:1783135575.134512:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135575.134518:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0275 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134524:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0275 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134542:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee027c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134548:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee027c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134554:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee027c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134559:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.134569:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee027c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134576:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee027c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134584:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8ac5424ce600) 00010000:00010000:0.0:1783135575.134587:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135575.134590:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee027c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134595:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee027c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134612:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134618:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134624:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134629:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.134632:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134639:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.134647:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135575.134649:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135575.137544:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.137573:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0283 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135575.138832:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:11411:x1869752786025344:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 Request processed in 4704us (14483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135575.138851:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 125 00000100:00100000:1.0:1783135575.145825:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135575.146033:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786025600 00000100:00100000:3.0:1783135575.146047:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786025600 00000100:00100000:3.0:1783135575.146166:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 126 00000100:00100000:3.0:1783135575.146180:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:11411:x1869752786025600:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135575.146210:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135575.146238:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee028a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d93 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146395:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0291 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146414:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0291 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146429:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0291 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135575.146444:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783135575.146553:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0291 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146561:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0291 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146569:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0291 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146599:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135575.146605:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0291 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146614:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0291 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146631:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:3.0:1783135575.146634:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783135575.146639:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0291 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146646:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0291 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146699:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee028a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d93 expref: 64 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146711:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:3.0:1783135575.146713:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135575.146716:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee028a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d93 expref: 64 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.146729:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030600, rc 0) 00000100:00100000:3.0:1783135575.147274:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+63:11411:x1869752786025600:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1093us (1470us total) trans 4294967400 rc 301/301 00000100:00100000:3.0:1783135575.147286:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 126 00000100:00100000:0.0:1783135575.162735:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135575.169477:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786025728 00000100:00100000:3.0:1783135575.169526:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786025728 00000100:00100000:3.0:1783135575.169627:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 127 00000100:00100000:3.0:1783135575.169638:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+63:11411:x1869752786025728:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783135575.169688:0:8461:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783135575.169882:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+63:11411:x1869752786025728:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 244us (7165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135575.169892:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 127 00000100:00100000:1.0:1783135575.175141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135575.179313:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786025984 00000100:00100000:3.0:1783135575.179335:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786025984 00000100:00100000:2.0:1783135575.179628:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 128 00000100:00100000:2.0:1783135575.179664:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c60c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+63:11411:x1869752786025984:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135575.179696:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135575.179701:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783135575.179740:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee022f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d77 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.179768:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135575.179783:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135575.179802:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee029f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140d9a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783135575.180425:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1783135575.180806:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee02a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.180832:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee02a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.180848:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee02a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.180993:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee029f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d9a expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.181020:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee02a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d9a expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.181030:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac67c558b00) 00010000:00010000:2.0:1783135575.181034:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135575.181612:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909000, rc 0) 00000100:00100000:2.0:1783135575.181786:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c60c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+64:11411:x1869752786025984:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 2111us (6693us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1783135575.181798:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 128 00000100:00100000:1.0:1783135575.189767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135575.190188:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786026240 00000100:00100000:3.0:1783135575.190207:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786026240 00000100:00100000:3.0:1783135575.190324:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 129 00000100:00100000:3.0:1783135575.190338:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+64:11411:x1869752786026240:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135575.190438:0:13464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135575.190481:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee02a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d9a expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.190508:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac67c558b00) 00010000:00010000:3.0:1783135575.190522:0:13464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135575.190559:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee02b4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.190704:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee02b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.190716:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee02b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.190895:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee02bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa7844d6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.190934:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee02bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7844d6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.190947:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee02bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7844d6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191030:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee02b4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191038:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee02b4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191045:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee02b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191052:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135575.191057:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee02b4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191066:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee02b4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191479:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:3.0:1783135575.191482:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135575.191487:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee02b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191492:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee02b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191510:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee02bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7844d6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191525:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee02bb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7844d6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191531:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee02bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7844d6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191536:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135575.191539:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee02bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7844d6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191545:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee02bb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa7844d6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191553:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa7844d6c (ffff8ac67c491c00) 00010000:00010000:3.0:1783135575.191555:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135575.191558:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee02bb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa7844d6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.191564:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee02bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa7844d6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135575.191823:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+63:11411:x1869752786026240:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 1482us (2058us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135575.191835:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 129 00000100:00100000:1.0:1783135575.204403:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135575.205195:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786026368 00000100:00100000:0.0:1783135575.205207:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786026368 00000100:00100000:0.0:1783135575.205278:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 130 00000100:00100000:0.0:1783135575.205290:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+63:11411:x1869752786026368:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135575.205314:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135575.205340:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee02c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140da1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.205379:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.205393:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.205407:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.205543:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee02c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da1 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.205563:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da1 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.205572:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:0.0:1783135575.205581:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135575.205585:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988400, rc 0) 00000100:00100000:0.0:1783135575.205655:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+64:11411:x1869752786026368:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 367us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135575.205662:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 130 00000100:00100000:1.0:1783135575.209477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.209569:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786026624 00000100:00100000:2.0:1783135575.209580:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786026624 00000100:00100000:2.0:1783135575.209644:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 131 00000100:00100000:2.0:1783135575.209656:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+64:11411:x1869752786026624:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135575.209744:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.209762:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.209790:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135575.209982:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1783135575.209993:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 479002905043ns, next at 480002902110ns, rc = 0 00000004:00010000:2.0:1783135575.210051:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef67f7f8 reply state 0000000096eaafd0 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.210067:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.210075:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:2.0:1783135575.210142:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783135575.210148:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135575.210266:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:11411:x1869752786026624:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 613us (799us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1783135575.210274:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 131 00000100:00100000:3.0:1783135575.216243:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135575.216385:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786026752 00000100:00100000:1.0:1783135575.216396:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786026752 00000100:00100000:1.0:1783135575.216459:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 132 00000100:00100000:1.0:1783135575.216471:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:11411:x1869752786026752:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135575.216497:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135575.216518:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee02d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140da8 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.216576:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee02d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da8 expref: 67 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.216592:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee02d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da8 expref: 67 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.216611:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:1.0:1783135575.216615:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135575.216634:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b000, rc 0) 00000100:00100000:1.0:1783135575.216705:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+67:11411:x1869752786026752:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 236us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135575.216713:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 132 00000100:00100000:3.0:1783135575.238356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135575.238784:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786026880 00000100:00100000:1.0:1783135575.238796:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786026880 00000100:00100000:1.0:1783135575.238902:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:1.0:1783135575.238915:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786026880:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783135575.239526:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2401:x1869752786026880:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 611us (1181us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783135575.239535:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00080000:2.0:1783135575.239745:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135575.257961:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.258187:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786027136 00000100:00100000:2.0:1783135575.258198:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786027136 00000100:00100000:2.0:1783135575.258264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:2.0:1783135575.258275:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+67:11411:x1869752786027136:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783135575.258525:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+68:11411:x1869752786027136:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 251us (573us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1783135575.258534:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:0.0:1783135575.264284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135575.264547:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786027392 00000100:00100000:1.0:1783135575.264558:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786027392 00000100:00100000:1.0:1783135575.264624:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 133 00000100:00100000:1.0:1783135575.264636:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+68:11411:x1869752786027392:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783135575.264753:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+68:11411:x1869752786027392:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 118us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135575.264762:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 133 00000100:00100000:3.0:1783135575.274346:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135575.274526:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786027520 00000100:00100000:1.0:1783135575.274537:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786027520 00000100:00100000:1.0:1783135575.274702:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 134 00000100:00100000:1.0:1783135575.274714:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+68:11411:x1869752786027520:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135575.274740:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135575.274763:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee02de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140daf expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.274875:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee02e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.274901:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee02e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.274914:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee02e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135575.274961:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135575.274990:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee02e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.275019:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee02de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140daf expref: 70 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.275040:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee02e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140daf expref: 69 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.275050:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:1.0:1783135575.275063:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783135575.275075:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b800, rc 0) 00000100:00100000:1.0:1783135575.275210:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+69:11411:x1869752786027520:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 498us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135575.275218:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 134 00000100:00100000:1.0:1783135575.279704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135575.280014:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786027648 00000100:00100000:3.0:1783135575.280027:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786027648 00000100:00100000:3.0:1783135575.280118:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:3.0:1783135575.280128:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2401:x1869752786027648:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135575.280159:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135575.280178:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78af296/0xf7de4ef628ee02ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140db6 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135575.280203:0:8620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487d57, blocks: 0x0 00010000:00010000:3.0:1783135575.280223:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1783135575.280228:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135575.280237:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78af296/0xf7de4ef628ee02ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140db6 expref: 10 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.280255:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a78af296/0xf7de4ef628ee02ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140db6 expref: 10 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.280267:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640031600, rc 0) 00000100:00100000:3.0:1783135575.280331:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2401:x1869752786027648:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 204us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135575.280339:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:0.0:1783135575.288270:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.288370:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786027904 00000100:00100000:2.0:1783135575.288385:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786027904 00000100:00100000:2.0:1783135575.288461:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 135 00000100:00100000:2.0:1783135575.288471:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+69:11411:x1869752786027904:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135575.288591:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+69:11411:x1869752786027904:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 120us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135575.288599:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 135 00000100:00100000:1.0:1783135575.305457:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135575.305930:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786028032 00000100:00100000:3.0:1783135575.305944:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786028032 00000100:00100000:3.0:1783135575.306025:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:3.0:1783135575.306038:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:11411:x1869752786028032:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135575.306064:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135575.306127:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140dbd expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.306172:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a78af296/0xf7de4ef628ee02ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140db6 expref: 11 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.306200:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135575.306205:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135575.306212:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.306257:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a78af296/0xf7de4ef628ee02ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140db6 expref: 11 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.306272:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a78af296/0xf7de4ef628ee02ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140db6 expref: 11 pid: 8620 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135575.306302:0:8437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1869752809172992:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135575.306435:0:8437:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135575.312296:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135575.312811:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786028160 00000100:00100000:0.0:1783135575.312829:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786028160 00010000:00010000:0.0:1783135575.312898:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a78af296/0xf7de4ef628ee02ec lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140db6 expref: 12 pid: 8620 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135575.312953:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 74 00000100:00100000:0.0:1783135575.312966:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6618a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:2400:x1869752786028160:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135575.312998:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135575.313029:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a78af296/0xf7de4ef628ee02ec lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140db6 expref: 12 pid: 8620 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.313047:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a78af296/0xf7de4ef628ee02ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140db6 expref: 12 pid: 8620 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.313121:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135575.313127:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135575.313140:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.313153:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.313211:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78af296/0xf7de4ef628ee02ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140db6 expref: 12 pid: 8620 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.313240:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135575.313259:0:6507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6507:1869752809173120:192.168.204.6@tcp:105: 00000100:00100000:1.0:1783135575.313319:0:8437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1869752809172992:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135575.313357:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.313371:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030600, rc 0) 00000100:00100000:0.0:1783135575.313389:0:6507:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6586f3000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135575.313948:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:11411:x1869752786028032:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 7909us (8506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135575.313959:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:2.0:1783135575.331873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135575.332018:0:6507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6507:1869752809173120:192.168.204.6@tcp:105: 00010000:00010000:0.0:1783135575.332064:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135575.332167:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6618a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2400:x1869752786028160:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 19202us (19893us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135575.332182:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 74 00000100:00100000:1.0:1783135575.334742:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786028288 00000100:00100000:1.0:1783135575.334764:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786028288 00002000:00100000:1.0:1783135575.334855:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8ac543794380 x1869752786028288/t0(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:746/0 lens 504/0 e 0 to 0 dl 1783135586 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783135575.334869:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac543794380 with x1869752786028288 ext(0->12) 00002000:00010000:1.0:1783135575.334876:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac543794380 00000100:00100000:2.0:1783135575.339571:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:2.0:1783135575.339606:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2401:x1869752786028288:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783135575.343302:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:2401:x1869752786028288:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 Request processed in 3691us (11423us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783135575.343320:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00002000:00100000:2.0:1783135575.343366:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8ac543794380 x1869752786028288/t4294967309(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:746/0 lens 504/448 e 0 to 0 dl 1783135586 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135575.343378:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac543794380 with x1869752786028288 ext(0->12) 00002000:00010000:2.0:1783135575.343395:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac543794380 00000100:00100000:2.0:1783135575.356968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135575.357065:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786028416 00000100:00100000:1.0:1783135575.357174:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786028416 00000100:00100000:1.0:1783135575.357251:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 136 00000100:00100000:1.0:1783135575.357261:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+69:11411:x1869752786028416:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783135575.369050:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:1.0:1783135575.369067:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:0.0:1783135575.369431:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369446:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369454:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369460:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.369466:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369484:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369507:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:0.0:1783135575.369530:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135575.369536:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369543:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628edfff8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369591:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369597:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369603:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369608:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.369611:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369617:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369634:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ac67c491000) 00010000:00010000:0.0:1783135575.369637:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135575.369640:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369646:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee00a0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369662:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369679:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369685:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369690:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.369693:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369699:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369707:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424ce900) 00010000:00010000:0.0:1783135575.369710:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135575.369713:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369720:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee011e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369730:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369736:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369741:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369746:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65ca00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.369754:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369761:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369781:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac5424ce900) 00010000:00010000:0.0:1783135575.369784:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135575.369787:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369792:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee0141 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369819:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369825:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369831:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369836:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.369839:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369845:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369853:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135575.369855:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135575.369864:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369870:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0213 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369883:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369890:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369896:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369901:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.369904:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369910:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369917:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:0.0:1783135575.369920:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783135575.369923:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.369928:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee02d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783135575.370185:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1783135575.370206:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ac642dac780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1783135575.370209:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac659ae8d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ac642dac480 00000020:00080000:1.0:1783135575.370221:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac659ae8c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac543a0e200 00000004:00080000:1.0:1783135575.370369:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:3.0:1783135575.370518:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135575.370543:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809173248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783135575.370631:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135575.370697:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809173248 00000100:00100000:3.0:1783135575.370705:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809173248 00000100:00100000:3.0:1783135575.370761:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135575.370783:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1869752809173248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783135575.370824:0:8620:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1783135575.370858:0:8620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a487d56, atime: 0x6a487d56, ctime: 0x6a487d56, blocks: 0x8 00010000:00010000:3.0:1783135575.370865:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000231d557a/0xf7de4ef628ee02fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.370888:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1783135575.370893:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135575.370899:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000231d557a/0xf7de4ef628ee02fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.370916:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000231d557a/0xf7de4ef628ee02fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.370924:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000231d557a/0xf7de4ef628ee02fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.370931:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000231d557a/0xf7de4ef628ee02fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.370949:0:8620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783135575.371173:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3649:x1869752809173248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 391us (551us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783135575.371181:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1783135575.371208:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135575.371215:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000231d557a/0xf7de4ef628ee02fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.371224:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031c00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135575.371229:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000231d557a/0xf7de4ef628ee02fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.371251:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000231d557a/0xf7de4ef628ee02fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.371997:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000231d557a/0xf7de4ef628ee02fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.372005:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000231d557a/0xf7de4ef628ee02fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.372029:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135575.372031:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135575.372034:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1783135575.372368:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:3.0:1783135575.372985:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac543a2df80/2, rc 0, transno 4294967305 00000100:00100000:3.0:1783135575.372996:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809173248:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1783135575.373729:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135575.379247:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809173504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783135575.379347:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135575.379437:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809173504 00000100:00100000:2.0:1783135575.379445:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809173504 00000100:00100000:2.0:1783135575.379523:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135575.379533:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1869752809173504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783135575.379698:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783135575.379701:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783135575 00002000:00010000:2.0:1783135575.379704:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783135575.379706:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783135575 -> 1783135575 00002000:00010000:2.0:1783135575.379708:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1783135575.379990:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809173376:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783135575.380022:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135575.380060:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809173376 00000100:00100000:3.0:1783135575.380065:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809173376 00000100:00100000:3.0:1783135575.380106:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783135575.380113:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1869752809173376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783135575.380144:0:8620:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1783135575.380163:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.380200:0:8620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee00ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d15 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.380210:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1783135575.380214:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135575.380219:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.380249:0:8620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee00ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d15 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.380721:0:8620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee00ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d15 expref: 11 pid: 8437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135575.380735:0:8620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8620:1869752809173632:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135575.380815:0:8620:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072180 going to sleep for 11 seconds 00000001:00080000:3.0:1783135575.385069:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1783135575.385109:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000020:00080000:1.0:1783135575.385265:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ac543072f00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1783135575.385272:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac543029200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ac5430726c0 00000020:00080000:1.0:1783135575.385276:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac6750ef400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac543b4c400 00000100:00100000:1.0:1783135575.385480:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11411:x1869752786028416:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 Request processed in 28205us (28519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135575.385490:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 136 00000100:00100000:1.0:1783135575.385645:0:8620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8620:1869752809173632:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135575.385670:0:8620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1783135575.386627:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1783135575.386696:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:3.0:1783135575.387394:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135575.388430:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3646:x1869752809173504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 8884us (9068us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783135575.388445:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1783135575.389426:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac543796d80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783135575.389438:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809173504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783135575.401055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135575.404079:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786028544 00000100:00100000:0.0:1783135575.404118:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786028544 00010000:00010000:0.0:1783135575.404186:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee00ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d15 expref: 12 pid: 8437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135575.404241:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 75 00000100:00100000:0.0:1783135575.404251:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:2400:x1869752786028544:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135575.404278:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135575.404284:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee00ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d15 expref: 12 pid: 8437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.404298:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee00ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d15 expref: 12 pid: 8437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.404322:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b992a30/0xf7de4ef628ee00ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d15 expref: 12 pid: 8437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.404338:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135575.404342:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135575.404347:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.404356:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.404407:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135575.405115:0:8620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.405129:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.405139:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.405147:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.405177:0:8620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783135575.405407:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1869752809173376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25293us (25382us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783135575.405418:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783135575.405529:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:2400:x1869752786028544:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 1278us (4482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135575.405538:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 75 00010000:00010000:3.0:1783135575.407029:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135575.407043:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.407081:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030e00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135575.407112:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.407126:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.407149:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.407156:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000def97f4/0xf7de4ef628ee0301 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135575.407189:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135575.407191:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135575.407193:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783135575.407246:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac543797100/2, rc 0, transno 4294967311 00000100:00100000:3.0:1783135575.407266:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809173376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783135575.417068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135575.420217:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786028672 00000100:00100000:0.0:1783135575.420234:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786028672 00000100:00100000:0.0:1783135575.420293:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:0.0:1783135575.420303:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:2401:x1869752786028672:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783135575.425601:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1783135575.425620:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1783135575.425866:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2401:x1869752786028672:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 Request processed in 5558us (8801us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135575.425878:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:2.0:1783135575.429577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135575.429844:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786028928 00000100:00100000:1.0:1783135575.429855:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786028928 00000100:00100000:1.0:1783135575.429923:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 137 00000100:00100000:1.0:1783135575.429934:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11411:x1869752786028928:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135575.431142:0:8461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135575.431178:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee02e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140daf expref: 16 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.431200:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:1.0:1783135575.431204:0:8461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135575.431236:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.431247:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.431256:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135575.431376:0:8461:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069bedc40 reply state 000000004a6cf7f4 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.431389:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.431415:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:1.0:1783135575.431417:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135575.431420:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135575.431589:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11411:x1869752786028928:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 1656us (2021us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1783135575.431597:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 137 00000100:00100000:3.0:1783135575.434233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.434358:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786029056 00000100:00100000:2.0:1783135575.434368:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786029056 00000100:00100000:2.0:1783135575.434424:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:2.0:1783135575.434433:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752786029056:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783135575.434582:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1783135575.434585:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1783135575 -> 1783135575 00002000:00010000:2.0:1783135575.434588:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783135574 00002000:00010000:2.0:1783135575.434603:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1783135575 -> 1783135575 00002000:00010000:2.0:1783135575.434605:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1783135575.435028:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2399:x1869752786029056:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 592us (800us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783135575.435037:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:0.0:1783135575.438728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135575.438824:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786029312 00000100:00100000:1.0:1783135575.438839:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786029312 00000100:00100000:1.0:1783135575.438914:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 138 00000100:00100000:1.0:1783135575.438924:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:11411:x1869752786029312:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783135575.439000:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.439017:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da1 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.439027:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.439062:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da1 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.439077:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da1 expref: 17 pid: 6523 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135575.439110:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809173760:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135575.439204:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135575.446636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.446732:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786029440 00000100:00100000:2.0:1783135575.446743:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786029440 00010000:00010000:2.0:1783135575.446812:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da1 expref: 18 pid: 6523 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135575.446857:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 76 00000100:00100000:2.0:1783135575.446868:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:2400:x1869752786029440:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135575.446885:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135575.446891:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da1 expref: 18 pid: 6523 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.446904:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da1 expref: 18 pid: 6523 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.446925:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:2.0:1783135575.446929:0:10346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.446938:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.446946:0:10346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.446981:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135575.447041:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:2400:x1869752786029440:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 175us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135575.447050:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 76 00010000:00010000:1.0:1783135575.448160:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee02c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da1 expref: 17 pid: 6523 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135575.448184:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809173760:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135575.448212:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.448222:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.448227:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.448269:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.448276:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.448282:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.448288:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135575.448292:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.448299:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.448311:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:1.0:1783135575.448314:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783135575.448330:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.448336:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee030f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135575.448405:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11411:x1869752786029312:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 Request processed in 9481us (9687us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783135575.448415:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 138 00000100:00100000:0.0:1783135575.454047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135575.454193:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786029568 00000100:00100000:1.0:1783135575.454203:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786029568 00000100:00100000:1.0:1783135575.454250:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:1.0:1783135575.454261:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2399:x1869752786029568:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783135575.454310:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.454331:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.454338:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135575.454341:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135575.454345:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.454377:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.454391:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 7 pid: 8437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135575.454422:0:8437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1869752809173888:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135575.454524:0:8437:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135575.461587:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135575.462019:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786029696 00000100:00100000:0.0:1783135575.462029:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786029696 00010000:00010000:0.0:1783135575.462073:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 8 pid: 8437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135575.462162:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:0.0:1783135575.462173:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786029696:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135575.462189:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135575.462211:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 8 pid: 8437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.462244:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 8 pid: 8437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.462269:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135575.462274:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135575.462280:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.462290:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.462312:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135575.462374:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786029696:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 203us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135575.462382:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 77 00010000:00010000:1.0:1783135575.463288:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008054436d/0xf7de4ef628ee02f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dbd expref: 7 pid: 8437 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135575.463308:0:8437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1869752809173888:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135575.463330:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.463340:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.463347:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.463368:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.463378:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.463386:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.463409:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b400 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135575.463414:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.463423:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.463438:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.463445:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5234d5a/0xf7de4ef628ee0316 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135575.463523:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752786029568:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 Request processed in 9263us (9488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135575.463532:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:3.0:1783135575.476539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135575.476937:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786029952 00000100:00100000:1.0:1783135575.476949:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786029952 00000100:00100000:1.0:1783135575.477018:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 139 00000100:00100000:1.0:1783135575.477028:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:11411:x1869752786029952:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783135575.477154:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.477174:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d69 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.477210:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.477252:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d69 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.477267:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d69 expref: 16 pid: 6522 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135575.477282:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809174016:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135575.477373:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135575.481399:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135575.481608:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786030080 00000100:00100000:0.0:1783135575.481620:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786030080 00010000:00010000:0.0:1783135575.481681:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d69 expref: 17 pid: 6522 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135575.481730:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:0.0:1783135575.481741:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:2400:x1869752786030080:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135575.481758:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135575.481781:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d69 expref: 17 pid: 6522 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.481832:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d69 expref: 17 pid: 6522 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.481864:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135575.481870:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee026e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d8c expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.481882:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.481891:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.481901:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.481926:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135575.481990:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:2400:x1869752786030080:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 251us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135575.481998:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 78 00010000:00010000:1.0:1783135575.482779:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c200/0xf7de4ef628ee020c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d69 expref: 16 pid: 6522 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135575.482813:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809174016:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135575.482843:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.482861:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.482868:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.483061:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.483075:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee02d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da8 expref: 16 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.484493:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.488269:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee02d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da8 expref: 16 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.488294:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee02d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da8 expref: 16 pid: 13464 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135575.488311:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544190000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809174144:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135575.488426:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6586f3600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135575.491743:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544190000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809174144:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135575.491787:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135575.505178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.507147:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786030208 00000100:00100000:2.0:1783135575.507163:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786030208 00010000:00010000:2.0:1783135575.507220:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee02d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da8 expref: 17 pid: 13464 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135575.507271:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:2.0:1783135575.507281:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:2400:x1869752786030208:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135575.507297:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135575.507304:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee02d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da8 expref: 17 pid: 13464 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.507318:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee02d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da8 expref: 17 pid: 13464 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.507342:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee02d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140da8 expref: 17 pid: 13464 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.507360:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:2.0:1783135575.507365:0:10346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.507376:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.507406:0:10346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.507443:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135575.507528:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:2400:x1869752786030208:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 247us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135575.507536:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 79 00010000:00010000:0.0:1783135575.508079:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.508114:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135575.508245:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1783135575.508369:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:0.0:1783135575.508407:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1783135575.508490:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544190000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869752809174272:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783135575.508556:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135575.508595:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135575.509261:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809174272 00000100:00100000:1.0:1783135575.509271:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809174272 00000100:00100000:1.0:1783135575.509324:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783135575.509333:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1869752809174272:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783135575.509431:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1869752809174272:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135575.509438:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783135575.509828:0:6522:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1783135575.509836:0:6522:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:0.0:1783135575.509860:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac543796d80, transno 4294967310 00000004:00080000:0.0:1783135575.509878:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac543797100, transno 4294967311 00000100:00100000:0.0:1783135575.509886:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544190000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869752809174272:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1783135575.510022:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:0.0:1783135575.510115:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544190000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869752809174400:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783135575.510153:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135575.510176:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caa000 going to sleep for 11 seconds 00000100:00100000:2.0:1783135575.510305:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809174400 00000100:00100000:2.0:1783135575.510311:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809174400 00000100:00100000:2.0:1783135575.510352:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783135575.510360:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1869752809174400:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783135575.510466:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1869752809174400:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (312us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1783135575.510473:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783135575.511319:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544190000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1869752809174400:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1783135575.511365:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511391:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511398:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511405:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.511409:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511417:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511433:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:0.0:1783135575.511436:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135575.511440:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511446:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0324 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511474:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511479:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511485:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511490:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.511500:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511506:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511514:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135575.511517:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135575.511524:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee026e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d8c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511535:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee026e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d8c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511544:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee026e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d8c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.511585:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee026e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d8c expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135575.511601:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809174528:192.168.204.6@tcp:105: 00000100:00100000:0.0:1783135575.511961:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caa000 going to sleep for 11 seconds 00000100:00100000:3.0:1783135575.518158:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.524544:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786030336 00000100:00100000:2.0:1783135575.524558:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786030336 00000100:00100000:2.0:1783135575.524653:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:2.0:1783135575.524664:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:11410:x1869752786030336:12345-192.168.204.6@tcp:49:lfs.0 00000100:00100000:2.0:1783135575.525055:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:11410:x1869752786030336:12345-192.168.204.6@tcp:49:lfs.0 Request processed in 392us (6906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135575.525064:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:0.0:1783135575.526209:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809174528:192.168.204.6@tcp:105: 00010000:00010000:0.0:1783135575.526240:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526250:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d200/0xf7de4ef628ee0267 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526303:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee032b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526317:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee032b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526329:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee032b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526339:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee032b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526345:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee032b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526351:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee032b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526358:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.526362:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee032b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526369:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee032b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526380:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135575.526383:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135575.526387:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee032b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526392:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee032b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526411:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526417:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526422:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526427:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135575.526430:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526435:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526443:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135575.526446:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135575.526448:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.526455:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee031d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135575.526671:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11411:x1869752786029952:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 49643us (50142us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1783135575.526682:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 139 00000020:00080000:0.0:1783135575.526687:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783135575.528396:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135575.528406:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135575.529188:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783135575.529202:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135575.534291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.534420:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786030592 00000100:00100000:2.0:1783135575.534436:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786030592 00000100:00100000:2.0:1783135575.534548:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 140 00000100:00100000:2.0:1783135575.534559:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11410:x1869752786030592:12345-192.168.204.6@tcp:58:lfs.0 00000040:00080000:2.0:1783135575.534750:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1783135575.534846:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11410:x1869752786030592:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 288us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135575.534854:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 140 00000100:00100000:3.0:1783135575.542708:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.543951:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786030848 00000100:00100000:2.0:1783135575.543966:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786030848 00000100:00100000:2.0:1783135575.544035:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:2.0:1783135575.544045:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6580b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:11411:x1869752786030848:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783135575.544376:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783135575.544418:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:2.0:1783135575.544455:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.544473:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.544486:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.544496:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.544502:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.544508:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135575.544543:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783135575.544654:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6580b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:11411:x1869752786030848:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 608us (1956us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1783135575.544663:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 32 00000020:00080000:2.0:1783135575.544667:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783135575.545340:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135575.545351:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.545369:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909000 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135575.545374:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.545382:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.545397:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:0.0:1783135575.545400:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783135575.545405:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.545411:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0332 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.545426:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135575.545427:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135575.545429:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135575.584389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135575.584591:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786030976 00000100:00100000:1.0:1783135575.584609:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786030976 00000100:00100000:1.0:1783135575.584704:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 141 00000100:00100000:1.0:1783135575.584715:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:11414:x1869752786030976:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135575.584740:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135575.584771:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee0339 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140dc4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.584837:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee0340 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.584853:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee0340 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.584864:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee0340 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.584878:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0347 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.584901:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0347 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.584908:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0347 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.584983:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.584994:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d85 expref: 22 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.585003:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.585036:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d85 expref: 22 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.585051:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d85 expref: 22 pid: 8461 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135575.585065:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809174656:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135575.585376:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135575.598900:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135575.599136:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786031232 00000100:00100000:2.0:1783135575.599146:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786031232 00000100:00100000:2.0:1783135575.599222:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:2.0:1783135575.599233:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:6173:x1869752786031232:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783135575.599481:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:6173:x1869752786031232:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 249us (593us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1783135575.599489:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:1.0:1783135575.599929:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809174656:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135575.599959:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135575.607578:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135575.607684:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786031360 00000100:00100000:0.0:1783135575.607694:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786031360 00010000:00010000:0.0:1783135575.607744:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d85 expref: 24 pid: 8461 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135575.607796:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:0.0:1783135575.607805:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:2400:x1869752786031360:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135575.607822:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135575.607836:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d85 expref: 24 pid: 8461 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.607876:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d85 expref: 24 pid: 8461 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.607901:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0259 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d85 expref: 24 pid: 8461 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.607919:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135575.607924:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.607934:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.607942:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135575.607972:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135575.608030:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:2400:x1869752786031360:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 226us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135575.608037:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 80 00010000:00010000:1.0:1783135575.608139:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608153:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135575.608208:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783135575.608212:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135575.608230:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608241:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608251:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee0340 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608258:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee0340 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608265:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee0340 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608270:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135575.608274:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee0340 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608281:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee0340 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608289:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:1.0:1783135575.608292:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135575.608295:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee0340 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608309:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee0340 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608322:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0347 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608328:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0347 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608333:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0347 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608338:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135575.608341:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0347 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608346:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0347 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608354:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ac672d8c600) 00010000:00010000:1.0:1783135575.608357:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135575.608360:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0347 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608366:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee0347 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608399:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee0339 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dc4 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608412:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dc4 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135575.608424:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:1.0:1783135575.608426:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135575.608428:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b000, rc 0) 00000100:00100000:1.0:1783135575.608453:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11414:x1869752786030976:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 23741us (24085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135575.608460:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 141 00010000:00010000:2.0:1783135575.933837:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135576.430612:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135576.430837:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809174784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135576.430921:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135576.431237:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809174784 00000100:00100000:0.0:1783135576.431246:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809174784 00000100:00100000:0.0:1783135576.431342:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783135576.431352:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809174784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135576.431403:0:13344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135576.431527:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809174784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135576.431551:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783135576.431645:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809174784:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1783135576.560548:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135576.560560:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135576.560589:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1783135576.560596:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135576.560760:0:13815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809174912:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135576.561025:0:13815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135576.566926:0:13815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809174912:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783135576.567577:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135576.568074:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786031488 00000100:00100000:2.0:1783135576.568083:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786031488 00000100:00080000:3.0:1783135576.568161:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135576.568176:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 142 00000100:00100000:2.0:1783135576.568187:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11425:x1869752786031488:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135576.568229:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135576.568379:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11425:x1869752786031488:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 192us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135576.568394:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 142 00000100:00100000:0.0:1783135576.581043:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135576.581140:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786031744 00000100:00100000:1.0:1783135576.581151:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786031744 00000100:00100000:1.0:1783135576.581217:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 143 00000100:00100000:1.0:1783135576.581230:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:11425:x1869752786031744:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135576.581255:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135576.581277:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee0355 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140dcb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.581414:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee035c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.581430:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee035c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.581457:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee035c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135576.581470:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783135576.581580:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee0355 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dcb expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.581600:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee035c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dcb expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.581609:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:1.0:1783135576.581612:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135576.581615:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b800, rc 0) 00000100:00100000:1.0:1783135576.581683:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:11425:x1869752786031744:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 457us (655us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1783135576.581692:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 143 00000100:00100000:3.0:1783135576.592135:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135576.592179:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135576.592264:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786032000 00000100:00100000:1.0:1783135576.592278:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786032000 00000100:00100000:1.0:1783135576.592482:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 144 00000100:00100000:1.0:1783135576.592497:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:11425:x1869752786032000:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783135576.592590:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee036a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.592608:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee036a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.592621:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee036a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135576.593427:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786032128 00000100:00100000:0.0:1783135576.593437:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786032128 00000100:00100000:0.0:1783135576.593498:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:0.0:1783135576.593509:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6618a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+26:2398:x1869752786032128:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135576.593526:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135576.593549:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee035c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dcb expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135576.593569:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135576.593575:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135576.593637:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6618a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:2398:x1869752786032128:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 130us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135576.593645:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00010000:00010000:1.0:1783135576.593702:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee036a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.593712:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee036a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.593717:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee036a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.593723:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135576.593729:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee036a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.593736:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee036a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.593756:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:1.0:1783135576.593759:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135576.593763:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee036a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135576.593768:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee036a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135576.594168:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:11425:x1869752786032000:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 1673us (2040us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1783135576.594177:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 144 00000040:00080000:0.0:1783135576.594258:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135576.594263:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135576.594852:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783135576.594863:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135576.597949:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135576.598034:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786032384 00000100:00100000:0.0:1783135576.598045:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786032384 00000100:00100000:0.0:1783135576.598135:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:0.0:1783135576.598146:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:11425:x1869752786032384:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783135576.598587:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:11425:x1869752786032384:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 442us (649us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1783135576.598596:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00000040:00080000:3.0:1783135576.651174:0:14278:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135576.651184:0:14278:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135576.651216:0:14278:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783135576.651223:0:14278:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135576.902412:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135576.902549:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786032640 00000100:00100000:2.0:1783135576.902573:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786032640 00000100:00100000:2.0:1783135576.902646:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 145 00000100:00100000:2.0:1783135576.902659:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:11438:x1869752786032640:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135576.902686:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135576.902709:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0371 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140dd2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135576.902836:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908600/0xf7de4ef628ee0378 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135576.902851:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908600/0xf7de4ef628ee0378 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135576.902864:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908600/0xf7de4ef628ee0378 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135576.902877:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783135576.902991:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0371 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dd2 expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135576.903009:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908600/0xf7de4ef628ee0378 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dd2 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135576.903019:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:2.0:1783135576.903022:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783135576.903026:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908600, rc 0) 00000100:00100000:2.0:1783135576.903133:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:11438:x1869752786032640:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 477us (732us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1783135576.903141:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 145 00000100:00100000:1.0:1783135576.908162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135576.910840:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786032768 00000100:00100000:0.0:1783135576.910854:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786032768 00000100:00100000:0.0:1783135576.910930:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 146 00000100:00100000:0.0:1783135576.910942:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:11438:x1869752786032768:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:0.0:1783135576.911016:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0386 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135576.911034:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0386 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135576.911046:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0386 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135576.911083:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0386 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135576.911112:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0386 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135576.911119:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0386 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135576.911125:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135576.911129:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0386 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135576.911136:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0386 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135576.911147:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:0.0:1783135576.911150:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135576.911165:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0386 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135576.911171:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0386 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135576.911248:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:11438:x1869752786032768:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 308us (3097us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135576.911256:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 146 00010000:00010000:3.0:1783135576.945167:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135577.069660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135577.069914:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786032896 00000100:00100000:3.0:1783135577.069926:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786032896 00000100:00100000:3.0:1783135577.070073:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:3.0:1783135577.070129:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752786032896:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:3.0:1783135577.070151:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135577.070178:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000231d557a/0xf7de4ef628ee038d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140dd9 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135577.070206:0:8620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a487d57, atime: 0x6a487d56, ctime: 0x6a487d57, blocks: 0x8 00010000:00010000:3.0:1783135577.070228:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1783135577.070233:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135577.070241:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000231d557a/0xf7de4ef628ee038d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dd9 expref: 7 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135577.070262:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000231d557a/0xf7de4ef628ee038d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dd9 expref: 7 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135577.070291:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640031c00, rc 0) 00000100:00100000:3.0:1783135577.070508:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2399:x1869752786032896:12345-192.168.204.6@tcp:101:cat.0 Request processed in 423us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135577.070515:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00080000:0.0:1783135577.074331:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135577.074794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135577.074974:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786033024 00000100:00100000:2.0:1783135577.074986:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786033024 00002000:00100000:2.0:1783135577.075038:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8ac67b3b2d80 x1869752786033024/t0(0) o3->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:748/0 lens 488/0 e 0 to 0 dl 1783135588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135577.075050:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac67b3b2d80 with x1869752786033024 ext(0->4095) 00002000:00010000:2.0:1783135577.075055:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac67b3b2d80 00000100:00100000:2.0:1783135577.075118:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:2.0:1783135577.075129:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2398:x1869752786033024:12345-192.168.204.6@tcp:3:cat.0 00000100:00100000:2.0:1783135577.075308:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2398:x1869752786033024:12345-192.168.204.6@tcp:3:cat.0 Request processed in 181us (519us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783135577.075316:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00002000:00100000:2.0:1783135577.075323:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8ac67b3b2d80 x1869752786033024/t0(0) o3->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:748/0 lens 488/4536 e 0 to 0 dl 1783135588 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135577.075330:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac67b3b2d80 with x1869752786033024 ext(0->4095) 00002000:00010000:2.0:1783135577.075333:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac67b3b2d80 00000100:00100000:1.0:1783135577.662747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135577.663337:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135577.663377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135577.663412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135577.663456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135577.663488:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786033664 00000100:00100000:1.0:1783135577.663497:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786033664 00000100:00100000:1.0:1783135577.663576:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786033280 00000100:00100000:1.0:1783135577.663580:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786033280 00000100:00100000:1.0:1783135577.663600:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786033536 00000100:00100000:1.0:1783135577.663603:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786033536 00000100:00100000:1.0:1783135577.663621:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 339 00000100:00100000:1.0:1783135577.663631:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786033664:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135577.663710:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786033664:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 79us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135577.663717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 339 00000100:00100000:1.0:1783135577.663746:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 340 00000100:00100000:1.0:1783135577.663753:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786033280:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135577.663790:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786033280:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135577.663796:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 340 00000100:00100000:1.0:1783135577.663807:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 341 00000100:00100000:1.0:1783135577.663814:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786033536:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135577.663837:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786033536:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135577.663844:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 341 00000100:00080000:1.0:1783135577.663868:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135577.663878:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135577.667204:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786033408 00000100:00100000:0.0:1783135577.667221:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786033408 00000100:00100000:0.0:1783135577.667312:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:0.0:1783135577.667323:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786033408:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135577.667394:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786033408:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 73us (4057us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135577.667401:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00080000:1.0:1783135577.667926:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135577.669143:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786033152 00000100:00100000:3.0:1783135577.669157:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786033152 00000100:00100000:3.0:1783135577.669230:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 393 00000100:00100000:3.0:1783135577.669240:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752786033152:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135577.669321:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752786033152:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 81us (6593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135577.669327:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 393 00010000:00010000:3.0:1783135577.966273:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135578.480506:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809175040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135578.480605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135578.480665:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135578.480672:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809175168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135578.480699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135578.480760:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809175040 00000100:00100000:1.0:1783135578.480768:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809175040 00000100:00100000:1.0:1783135578.480821:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809175168 00000100:00100000:1.0:1783135578.480825:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809175168 00000100:00100000:1.0:1783135578.480845:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783135578.480854:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809175040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135578.480887:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135578.480927:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809175040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.480934:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783135578.480951:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783135578.480957:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809175168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135578.480969:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135578.480996:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809175168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.481002:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1783135578.481020:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135578.481060:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809175168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135578.481073:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135578.481074:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1783135578.481082:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000100:00100000:3.0:1783135578.481100:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809175296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135578.481134:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1783135578.481136:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac67b3b1f80, transno 4294967302 00000004:00080000:1.0:1783135578.481150:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1783135578.481164:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac543a2df80, transno 4294967305 00000100:00100000:1.0:1783135578.481174:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809175040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135578.481198:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809175296 00000100:00100000:1.0:1783135578.481201:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809175296 00000100:00100000:1.0:1783135578.481247:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783135578.481253:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869752809175296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135578.481283:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783135578.481319:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1869752809175296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.481326:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1783135578.481345:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135578.481467:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809175296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135578.483152:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135578.483175:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809175424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135578.483240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135578.483350:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809175424 00000100:00100000:3.0:1783135578.483357:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809175424 00000100:00100000:3.0:1783135578.483411:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783135578.483420:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809175424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135578.483455:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1783135578.483512:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809175424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135578.483519:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783135578.483665:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809175424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135578.490975:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809175680:0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.491048:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809175936:0@lo:400:kworker.0 00000100:00100000:3.0:1783135578.491065:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135578.491146:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135578.491155:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809176192:0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.491175:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809176448:0@lo:400:kworker.0 00000100:00100000:3.0:1783135578.491188:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135578.491215:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809176704:0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.491217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135578.491248:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135578.491255:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783135578.491265:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809175808:0@lo:400:kworker.0 00000100:00100000:3.0:1783135578.491274:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1783135578.491282:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809175552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135578.491308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135578.491331:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809176320:0@lo:400:kworker.0 00000100:00100000:3.0:1783135578.491334:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135578.491358:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809176064:0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.491372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135578.491394:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135578.491414:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809176576:0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.491421:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809175936 00000100:00100000:1.0:1783135578.491431:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809175936 00000100:00100000:3.0:1783135578.491435:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135578.491478:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809176192 00000100:00100000:1.0:1783135578.491481:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809176192 00000100:00080000:3.0:1783135578.491529:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135578.491530:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809176704 00000100:00100000:1.0:1783135578.491534:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809176704 00000100:00080000:3.0:1783135578.491554:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135578.491556:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809175808 00000100:00100000:1.0:1783135578.491560:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809175808 00000100:00100000:1.0:1783135578.491571:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809176320 00000100:00100000:1.0:1783135578.491573:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809176320 00000100:00100000:1.0:1783135578.491601:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809176576 00000100:00100000:1.0:1783135578.491605:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809176576 00000100:00080000:3.0:1783135578.491613:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135578.491618:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135578.491626:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1783135578.491635:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809175936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.491699:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809175936:12345-0@lo:400:kworker.0 Request processed in 64us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.491717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1783135578.491736:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1783135578.491797:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809175936:0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.491938:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809176192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.491985:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809176192:12345-0@lo:400:kworker.0 Request processed in 243us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.491992:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1783135578.492005:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1783135578.492011:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809176704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.492039:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1869752809176704:12345-0@lo:400:kworker.0 Request processed in 28us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.492045:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1783135578.492066:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783135578.492071:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809175808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.492138:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809175808:12345-0@lo:400:kworker.0 Request processed in 67us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.492145:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1783135578.492158:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1783135578.492166:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809176320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135578.492200:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809176192:0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.492202:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809176320:12345-0@lo:400:kworker.0 Request processed in 37us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.492213:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00080000:3.0:1783135578.492222:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543add180 x1869752809176704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135578.492231:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1783135578.492240:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809176704:0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.492246:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809176576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.492847:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809176576:12345-0@lo:400:kworker.0 Request processed in 603us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.492856:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1783135578.492885:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809176448 00000100:00100000:1.0:1783135578.492891:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809176448 00000100:00100000:3.0:1783135578.492912:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809176576:0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.492941:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783135578.492948:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809176448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.492980:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809176448:12345-0@lo:400:kworker.0 Request processed in 34us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.492986:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1783135578.493013:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135578.493026:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809175552 00000100:00100000:1.0:1783135578.493029:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809175552 00000100:00100000:1.0:1783135578.493058:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783135578.493065:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809175552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135578.493107:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783135578.493154:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809175552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135578.493163:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783135578.493183:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809175552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135578.493231:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809175808:0@lo:400:kworker.0 00010000:00080000:1.0:1783135578.493244:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543adf100 x1869752809176320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135578.493255:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809176320:0@lo:400:kworker.0 00000100:00100000:1.0:1783135578.493264:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809176448:0@lo:400:kworker.0 00000100:00100000:0.0:1783135578.494457:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809175680 00000100:00100000:0.0:1783135578.494467:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809175680 00000100:00100000:0.0:1783135578.494532:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1783135578.494541:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809175680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135578.494606:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809175680:12345-0@lo:400:kworker.0 Request processed in 67us (3542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135578.494613:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1783135578.494648:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809176064 00000100:00100000:0.0:1783135578.494652:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809176064 00000100:00100000:0.0:1783135578.494677:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1783135578.494684:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809176064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135578.495125:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809176064:12345-0@lo:400:kworker.0 Request processed in 440us (3730us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135578.495133:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1783135578.495175:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809176064:0@lo:400:kworker.0 00000100:00100000:0.0:1783135578.495186:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809175680:0@lo:400:kworker.0 00000040:00080000:0.0:1783135578.670331:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135578.670342:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135578.670368:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783135578.670377:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1783135578.865446:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135578.992216:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135580.017996:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135581.039251:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783135581.052540:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1783135581.052557:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1783135581.069200:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1783135581.069239:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ac646caa3c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1783135581.069244:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac66b500000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ac646caa0c0 00000020:00080000:0.0:1783135581.069249:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac66b500800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac54418ee00 00000020:00080000:3.0:1783135581.069342:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:3.0:1783135581.069421:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1783135581.069570:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135581.069583:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135581.069593:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135581.069599:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135581.069605:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135581.069613:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135581.069632:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ac5424ce600) 00010000:00010000:1.0:1783135581.069635:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135581.069651:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135581.069658:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee0308 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783135581.069823:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:1.0:1783135581.550491:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809176832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135581.550632:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135581.550851:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809176832 00000100:00100000:2.0:1783135581.550871:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809176832 00000100:00100000:2.0:1783135581.550937:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783135581.550947:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809176832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783135581.551145:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1783135581.551217:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809176832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 271us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135581.551241:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783135581.551423:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809176832:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135582.065480:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135582.776430:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135582.776490:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135582.776500:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786033792 00000100:00100000:1.0:1783135582.776510:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786033792 00000100:00100000:1.0:1783135582.776577:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 395 00000100:00100000:3.0:1783135582.776584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135582.776587:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2401:x1869752786033792:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135582.776611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135582.776643:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135582.776857:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2401:x1869752786033792:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 270us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.776865:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 395 00000100:00100000:1.0:1783135582.776903:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786034048 00000100:00100000:1.0:1783135582.776906:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786034048 00000100:00100000:1.0:1783135582.776941:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786034560 00000100:00100000:1.0:1783135582.776945:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786034560 00000100:00100000:1.0:1783135582.776962:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786033920 00000100:00100000:1.0:1783135582.776965:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786033920 00000100:00100000:1.0:1783135582.776981:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 348 00000100:00100000:1.0:1783135582.776987:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752786034048:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135582.777198:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 349 00000100:00100000:2.0:1783135582.777209:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752786034560:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135582.779766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135582.779962:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135582.780185:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786034304 00000100:00100000:3.0:1783135582.780194:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786034304 00000100:00100000:3.0:1783135582.780253:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786034176 00000100:00100000:3.0:1783135582.780256:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786034176 00000100:00100000:3.0:1783135582.780285:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 100 00000100:00100000:3.0:1783135582.780295:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752786034304:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135582.780447:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752786034304:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 153us (3861us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135582.780460:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 100 00000100:00100000:3.0:1783135582.780484:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 101 00000100:00100000:3.0:1783135582.780492:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2401:x1869752786034176:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135582.780519:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2401:x1869752786034176:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135582.780548:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 101 00000100:00100000:1.0:1783135582.788271:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786034432 00000100:00100000:1.0:1783135582.788307:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786034432 00000100:00100000:1.0:1783135582.788387:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 350 00000100:00100000:1.0:1783135582.788397:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:2401:x1869752786033920:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135582.788508:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:2401:x1869752786033920:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 112us (11863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.788516:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 350 00000100:00100000:1.0:1783135582.788534:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 351 00000100:00100000:1.0:1783135582.788541:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752786034432:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135582.788567:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752786034432:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (8605us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.788573:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 351 00000100:00080000:1.0:1783135582.788591:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135582.788597:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135582.788600:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135582.788602:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135582.788621:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2401:x1869752786034048:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 11633us (12130us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.788639:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 348 00000100:00100000:2.0:1783135582.793202:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752786034560:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 15981us (16575us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135582.793217:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 349 00000100:00100000:3.0:1783135582.873919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135582.874137:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786034688 00000100:00100000:1.0:1783135582.874150:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786034688 00000100:00100000:1.0:1783135582.874241:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 147 00000100:00100000:1.0:1783135582.874251:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:11098:x1869752786034688:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783135582.874375:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:11098:x1869752786034688:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 Request processed in 125us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.874384:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 147 00000100:00100000:3.0:1783135582.877820:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135582.877929:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786034816 00000100:00100000:1.0:1783135582.877938:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786034816 00000100:00100000:1.0:1783135582.878044:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 148 00000100:00100000:1.0:1783135582.878054:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:11098:x1869752786034816:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783135582.878231:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:11098:x1869752786034816:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 Request processed in 169us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.878240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 148 00000100:00100000:0.0:1783135582.894338:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135582.895294:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786035072 00000100:00100000:1.0:1783135582.895308:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786035072 00000100:00100000:1.0:1783135582.895376:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:1.0:1783135582.895387:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:11098:x1869752786035072:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783135582.895702:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:11098:x1869752786035072:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 315us (1373us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1783135582.895710:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00010000:00010000:0.0:1783135583.086825:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135583.198659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135583.199440:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786035200 00000100:00100000:2.0:1783135583.199453:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786035200 00000100:00100000:2.0:1783135583.199574:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 149 00000100:00100000:2.0:1783135583.199585:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:11896:x1869752786035200:12345-192.168.204.6@tcp:101:lsof.0 00010000:00010000:2.0:1783135583.199609:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135583.199642:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee0394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140de0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135583.199711:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135583.199727:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135583.199740:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135583.199795:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135583.199799:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135583.199835:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135583.199879:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee0394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de0 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135583.199913:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de0 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135583.199921:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:2.0:1783135583.199924:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135583.199928:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908e00, rc 0) 00000100:00100000:2.0:1783135583.199998:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:11896:x1869752786035200:12345-192.168.204.6@tcp:101:lsof.0 Request processed in 415us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135583.200006:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 149 00000100:00100000:1.0:1783135583.599372:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135583.599401:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809176960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135583.599528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135583.600590:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809176960 00000100:00100000:0.0:1783135583.600602:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809176960 00000100:00100000:0.0:1783135583.600700:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783135583.600713:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809176960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135583.600748:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783135583.600821:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809176960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.600828:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783135583.600876:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809177216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135583.600930:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135583.600959:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135583.600969:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809177088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135583.600993:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135583.601073:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809177472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135583.601080:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809177344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135583.601174:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135583.601351:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809177728:0@lo:400:kworker.0 00000100:00100000:1.0:1783135583.601424:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809177600:0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.603598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135583.603711:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1783135583.603722:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1783135583.603768:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809176960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135583.603807:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809177856:0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.603864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135583.603889:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809178368:0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.603913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135583.603933:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783135583.603939:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809177984:0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.603960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135583.603976:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809178496:0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.603995:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135583.604044:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809177344 00000100:00100000:0.0:1783135583.604052:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809177344 00000100:00100000:0.0:1783135583.604126:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809177856 00000100:00100000:0.0:1783135583.604130:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809177856 00000100:00100000:0.0:1783135583.604147:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783135583.604155:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809177344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135583.604189:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1783135583.604252:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809177344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.604260:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783135583.604282:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783135583.604289:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809177856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.604319:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809177856:12345-0@lo:400:kworker.0 Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.604325:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783135583.604344:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809178368 00000100:00100000:0.0:1783135583.604347:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809178368 00000100:00100000:0.0:1783135583.604381:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809177984 00000100:00100000:0.0:1783135583.604384:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809177984 00000100:00100000:0.0:1783135583.604402:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783135583.604409:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809178368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.604438:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809178368:12345-0@lo:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.604444:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1783135583.604453:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809178496 00000100:00100000:0.0:1783135583.604455:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809178496 00000100:00100000:0.0:1783135583.604470:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1783135583.604475:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809177984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.604502:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809177984:12345-0@lo:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.604507:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1783135583.604519:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1783135583.604524:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809178496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.604545:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809178496:12345-0@lo:400:kworker.0 Request processed in 22us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.604557:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1783135583.604579:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809177216 00000100:00100000:0.0:1783135583.604583:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809177216 00000100:00100000:0.0:1783135583.604601:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809177088 00000100:00100000:0.0:1783135583.604604:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809177088 00000100:00100000:0.0:1783135583.604630:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809177472 00000100:00100000:0.0:1783135583.604633:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809177472 00000100:00100000:0.0:1783135583.604647:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783135583.604653:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809177216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135583.604672:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135583.604703:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809177216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (3776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.604710:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783135583.604721:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783135583.604727:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809177088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135583.604737:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135583.604759:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809177088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.604764:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783135583.604773:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783135583.604778:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809177472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783135583.604788:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783135583.604813:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809177472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (3641us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.604818:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783135583.604848:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809177984:0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.604868:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809178496:0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.604876:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809177856:0@lo:400:kworker.0 00010000:00080000:0.0:1783135583.604887:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67e2a2680 x1869752809178368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135583.604897:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809178368:0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.604911:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809177344:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1783135583.604971:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135583.604976:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135583.604978:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135583.604980:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135583.607520:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809177472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135583.607689:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135583.607769:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809178240:0@lo:400:kworker.0 00000100:00100000:2.0:1783135583.607869:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135583.608480:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809177088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135583.608500:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809177216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135583.608575:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809177728 00000100:00100000:3.0:1783135583.608588:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809177728 00000100:00100000:3.0:1783135583.608677:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809178240 00000100:00100000:3.0:1783135583.608681:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809178240 00000100:00100000:3.0:1783135583.608727:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1783135583.608738:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809177728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.609016:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1783135583.609030:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809178240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135583.609517:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135583.609567:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809178112:0@lo:400:kworker.0 00000100:00100000:1.0:1783135583.609608:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135583.609640:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809178624:0@lo:400:kworker.0 00000100:00100000:1.0:1783135583.609662:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135583.609710:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809177600 00000100:00100000:1.0:1783135583.609717:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809177600 00000100:00100000:1.0:1783135583.609770:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1783135583.609780:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809177600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135583.609849:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809177600:12345-0@lo:400:kworker.0 Request processed in 70us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135583.609872:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1783135583.610009:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809178624 00000100:00100000:2.0:1783135583.610014:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809178624 00000100:00100000:2.0:1783135583.610047:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1783135583.610054:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809178624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.610420:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809178240:12345-0@lo:400:kworker.0 Request processed in 107us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.610435:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1783135583.610727:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809178112 00000100:00100000:0.0:1783135583.610735:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809178112 00000100:00100000:0.0:1783135583.610784:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783135583.611461:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809178112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135583.614722:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809177728:12345-0@lo:400:kworker.0 Request processed in 5959us (7014us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135583.614746:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00080000:3.0:1783135583.615571:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135583.615581:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135583.615708:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809178624:12345-0@lo:400:kworker.0 Request processed in 5641us (6031us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135583.615716:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809177728:0@lo:400:kworker.0 00000100:00100000:3.0:1783135583.615741:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809178240:0@lo:400:kworker.0 00000100:00100000:2.0:1783135583.615764:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1783135583.617717:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809178112:12345-0@lo:400:kworker.0 Request processed in 6912us (8094us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135583.617735:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783135583.621877:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809177600:0@lo:400:kworker.0 00000100:00100000:0.0:1783135583.622077:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809178112:0@lo:400:kworker.0 00010000:00080000:0.0:1783135583.622419:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67e2a0a80 x1869752809178624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135583.622434:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809178624:0@lo:400:kworker.0 00010000:00010000:1.0:1783135584.110529:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135585.138076:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135586.158590:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135586.670432:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809178752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135586.670551:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135586.670625:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809178752 00000100:00100000:0.0:1783135586.670635:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809178752 00000100:00100000:0.0:1783135586.670701:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783135586.670713:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809178752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135586.670761:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135586.670830:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809178752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135586.670838:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783135586.670936:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809178752:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1783135586.940925:0:14476:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:26:26 (1783135586) 00010000:00010000:2.0:1783135587.182710:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783135587.195065:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1783135587.195108:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1783135587.201517:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1783135587.201568:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1783135587.896232:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135587.896293:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135587.896329:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135587.896354:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135587.896385:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786035840 00000100:00100000:3.0:1783135587.896396:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786035840 00000100:00100000:3.0:1783135587.896466:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:3.0:1783135587.896478:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786035840:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135587.896731:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786035840:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 254us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135587.896741:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:3.0:1783135587.896776:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786035584 00000100:00100000:3.0:1783135587.896781:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786035584 00000100:00100000:3.0:1783135587.896853:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786036096 00000100:00100000:3.0:1783135587.896857:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786036096 00000100:00100000:3.0:1783135587.896886:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 358 00000100:00100000:3.0:1783135587.896893:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786035584:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135587.896928:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786035584:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 36us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135587.896935:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 358 00000100:00100000:3.0:1783135587.896948:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 359 00000100:00100000:3.0:1783135587.896955:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786036096:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135587.896978:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786036096:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135587.897006:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 359 00000100:00080000:3.0:1783135587.897025:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135587.897031:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135587.897066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135587.897514:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786035456 00000100:00100000:0.0:1783135587.897521:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786035456 00000100:00100000:0.0:1783135587.897581:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 360 00000100:00100000:0.0:1783135587.897592:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:2400:x1869752786035456:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135587.897637:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:2400:x1869752786035456:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 49us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135587.897644:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 360 00000100:00080000:0.0:1783135587.897712:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135587.898045:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786035328 00000100:00100000:1.0:1783135587.898052:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786035328 00000100:00100000:1.0:1783135587.898111:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 397 00000100:00100000:1.0:1783135587.898121:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752786035328:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135587.898158:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752786035328:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 39us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135587.898165:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 397 00000100:00100000:0.0:1783135587.898742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135587.898793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135587.898866:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786035968 00000100:00100000:1.0:1783135587.898872:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786035968 00000100:00100000:1.0:1783135587.898933:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 361 00000100:00100000:1.0:1783135587.898941:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752786035968:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135587.898994:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752786035968:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 54us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135587.899001:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 361 00000100:00080000:0.0:1783135587.899318:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135587.900499:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786035712 00000100:00100000:2.0:1783135587.900513:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786035712 00000100:00100000:2.0:1783135587.900619:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 103 00000100:00100000:2.0:1783135587.900631:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752786035712:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135587.900709:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752786035712:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 81us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135587.900716:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 103 00000100:00080000:0.0:1783135587.900800:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1783135588.080343:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783135588.206558:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135588.337363:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135588.337518:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786036352 00000100:00100000:0.0:1783135588.337571:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786036352 00000100:00100000:0.0:1783135588.337661:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 150 00000100:00100000:0.0:1783135588.337674:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:12163:x1869752786036352:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135588.337702:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135588.337730:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee03a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140de7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.337834:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee03a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.337851:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee03a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.337869:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee03a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.337889:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee03b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.337896:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee03b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.337903:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee03b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338050:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee03b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338060:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee03b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338068:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee03b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135588.338121:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1783135588.338238:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee03a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338245:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee03a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338252:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee03a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338259:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135588.338264:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee03a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338273:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee03a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338288:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ac672e7a000) 00010000:00010000:0.0:1783135588.338291:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135588.338297:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee03a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338304:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee03a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338327:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee03b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338333:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee03b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338350:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee03b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338365:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135588.338368:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee03b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338376:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee03b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338385:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ac5424cc600) 00010000:00010000:0.0:1783135588.338387:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135588.338390:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee03b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338396:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee03b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338784:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee03a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de7 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338802:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee03b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de7 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135588.338810:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:0.0:1783135588.338812:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135588.338815:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989000, rc 0) 00000100:00100000:0.0:1783135588.339884:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:12163:x1869752786036352:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 2201us (2537us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1783135588.339914:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 150 00000100:00100000:3.0:1783135588.353918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135588.354065:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786036480 00000100:00100000:0.0:1783135588.354079:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786036480 00000100:00100000:0.0:1783135588.354209:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 151 00000100:00100000:0.0:1783135588.354222:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:12163:x1869752786036480:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783135588.354396:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:12163:x1869752786036480:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 Request processed in 175us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135588.354405:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 151 00000100:00100000:1.0:1783135588.359036:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135588.359211:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786036608 00000100:00100000:3.0:1783135588.359225:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786036608 00000100:00100000:3.0:1783135588.359321:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:3.0:1783135588.359334:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:2399:x1869752786036608:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135588.359545:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135588.359643:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee03b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de7 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135588.359670:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:3.0:1783135588.359676:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135588.359759:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f887b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:2399:x1869752786036608:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 427us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135588.359769:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:2.0:1783135588.365729:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135588.365895:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786036736 00000100:00100000:1.0:1783135588.365909:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786036736 00000100:00100000:1.0:1783135588.365991:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 152 00000100:00100000:1.0:1783135588.366003:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:12163:x1869752786036736:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783135588.366174:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:12163:x1869752786036736:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 Request processed in 172us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135588.366208:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 152 00000100:00100000:0.0:1783135588.718549:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809178880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135588.718667:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135588.718783:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809178880 00000100:00100000:0.0:1783135588.718793:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809178880 00000100:00100000:0.0:1783135588.718877:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783135588.718891:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809178880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783135588.718933:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1783135588.718990:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809178880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135588.718998:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1783135588.719026:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135588.719077:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809178880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135588.719553:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809179136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135588.719601:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135588.719688:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809179008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135588.719727:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135588.719776:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809179008 00000100:00100000:3.0:1783135588.719781:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809179008 00000100:00100000:3.0:1783135588.719845:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783135588.719854:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809179008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135588.719872:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1783135588.719928:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809179008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135588.719935:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1783135588.719955:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135588.719984:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809179008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135588.720224:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809179136 00000100:00100000:0.0:1783135588.720230:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809179136 00000100:00100000:0.0:1783135588.720266:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783135588.720273:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809179136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135588.720306:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1783135588.723245:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809179264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135588.723342:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135588.723439:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809179264 00000100:00100000:3.0:1783135588.723449:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809179264 00000100:00100000:3.0:1783135588.723535:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783135588.723552:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809179264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135588.723596:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135588.723652:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809179264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135588.723660:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1783135588.724566:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135588.724590:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135588.724613:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809179392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135588.724671:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135588.724741:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809179392 00000100:00100000:3.0:1783135588.724748:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809179392 00000100:00100000:3.0:1783135588.724795:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783135588.724820:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809179392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135588.724843:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135588.724883:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809179392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135588.724889:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1783135588.724925:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135588.724969:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809179264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135588.725006:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809179392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135588.727352:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809179776:0@lo:400:kworker.0 00000100:00100000:1.0:1783135588.727449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135588.727492:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809180288:0@lo:400:kworker.0 00000100:00100000:1.0:1783135588.727526:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135588.727551:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783135588.727557:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809179648:0@lo:400:kworker.0 00000100:00100000:1.0:1783135588.727582:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135588.727613:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809180160:0@lo:400:kworker.0 00000100:00100000:1.0:1783135588.727641:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135588.727681:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809179776 00000100:00100000:1.0:1783135588.731320:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809179776 00000100:00100000:1.0:1783135588.731461:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809180288 00000100:00100000:1.0:1783135588.731466:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809180288 00000100:00100000:1.0:1783135588.731494:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809179648 00000100:00100000:1.0:1783135588.731497:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809179648 00000100:00100000:1.0:1783135588.731508:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809180160 00000100:00100000:1.0:1783135588.731511:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809180160 00000100:00100000:1.0:1783135588.731548:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1783135588.731561:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809179776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135588.731718:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809179776:12345-0@lo:400:kworker.0 Request processed in 158us (4267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135588.731727:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1783135588.731748:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1783135588.731779:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809180288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.733695:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809179136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 13400us (14070us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135588.733714:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783135588.733830:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809179520:0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.733926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135588.733990:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809180032:0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.734025:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135588.734047:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783135588.734054:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809179904:0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.734082:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135588.734137:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809180416:0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.734164:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135588.734196:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809180032 00000100:00100000:0.0:1783135588.734205:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809180032 00000100:00100000:0.0:1783135588.734248:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809180416 00000100:00100000:0.0:1783135588.734251:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809180416 00000100:00100000:0.0:1783135588.734268:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1783135588.734278:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809179648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.734335:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809179648:12345-0@lo:400:kworker.0 Request processed in 59us (6752us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135588.734342:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1783135588.734357:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1783135588.734364:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809180160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.734393:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809180160:12345-0@lo:400:kworker.0 Request processed in 30us (6752us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135588.734399:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1783135588.734434:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1783135588.734441:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809180032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.734475:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1869752809180032:12345-0@lo:400:kworker.0 Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135588.734482:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1783135588.734494:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1783135588.734500:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809180416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.734543:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809180416:12345-0@lo:400:kworker.0 Request processed in 43us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135588.734549:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00010000:00080000:0.0:1783135588.734596:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac544174700 x1869752809180416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135588.734613:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809180416:0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.734627:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1869752809180032:0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.734677:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809179136:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1783135588.734768:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135588.734773:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135588.734802:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809179648:0@lo:400:kworker.0 00010000:00080000:0.0:1783135588.734817:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac544174e00 x1869752809180160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135588.734828:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809180160:0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.734844:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809179776:0@lo:400:kworker.0 00000100:00100000:1.0:1783135588.735366:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809180288:12345-0@lo:400:kworker.0 Request processed in 3584us (7846us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135588.735378:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1783135588.735431:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809179904 00000100:00100000:1.0:1783135588.735438:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809179904 00000100:00100000:1.0:1783135588.735481:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783135588.735488:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809179904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135588.735545:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809179904:12345-0@lo:400:kworker.0 Request processed in 57us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135588.735552:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783135588.735588:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809179904:0@lo:400:kworker.0 00000100:00100000:3.0:1783135588.735779:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809179520 00000100:00100000:3.0:1783135588.735786:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809179520 00000100:00100000:3.0:1783135588.736168:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1783135588.736179:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809179520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135588.736231:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3647:x1869752809179520:12345-0@lo:400:kworker.0 Request processed in 56us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135588.736238:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1783135588.738139:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809179520:0@lo:400:kworker.0 00000100:00100000:0.0:1783135588.738658:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809180288:0@lo:400:kworker.0 00000040:00080000:2.0:1783135588.918953:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135588.918969:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135588.919140:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1783135588.919148:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1783135589.103919:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783135589.231275:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135590.261438:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135590.917648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135590.919592:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786036864 00000100:00100000:3.0:1783135590.919613:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786036864 00000100:00100000:3.0:1783135590.919726:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 153 00000100:00100000:3.0:1783135590.919740:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:12205:x1869752786036864:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135590.919768:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135590.919797:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee03c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140dee expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.919888:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee03cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.919908:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee03cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.919923:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee03cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.919953:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee03d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.919960:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee03d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.919967:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee03d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920030:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee03cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920038:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee03cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920046:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee03cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920053:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135590.920059:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee03cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920068:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee03cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920081:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:3.0:1783135590.920085:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135590.920107:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee03cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920113:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee03cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920133:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee03d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920139:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee03d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920147:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee03d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920153:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135590.920156:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee03d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920164:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee03d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920187:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ac67c492200) 00010000:00010000:3.0:1783135590.920190:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135590.920193:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee03d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920200:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee03d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920240:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee03c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dee expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920252:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:3.0:1783135590.920255:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135590.920265:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee03c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dee expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135590.920276:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030600, rc 0) 00000100:00100000:3.0:1783135590.920366:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:12205:x1869752786036864:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 630us (2728us total) trans 0 rc 301/301 00000100:00100000:3.0:1783135590.920374:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 153 00000100:00080000:3.0:1783135590.920404:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135590.935839:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135590.935890:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786037120 00000100:00100000:1.0:1783135590.935903:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786037120 00000100:00100000:1.0:1783135590.935971:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 154 00000100:00100000:1.0:1783135590.935982:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+14:12205:x1869752786037120:12345-192.168.204.6@tcp:36:lfs.0 00010000:00010000:1.0:1783135590.936068:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135590.936135:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628edfd19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c12 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.936158:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:1.0:1783135590.936164:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135590.936264:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.936282:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de0 expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.936292:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.936333:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de0 expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.936350:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de0 expref: 5 pid: 6522 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135590.936368:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809180544:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135590.936492:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135590.948358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135590.949798:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809180544:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135590.949836:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135590.951739:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786037248 00000100:00100000:2.0:1783135590.951755:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786037248 00010000:00010000:2.0:1783135590.951841:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de0 expref: 6 pid: 6522 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135590.951886:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:2.0:1783135590.951896:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752786037248:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135590.951916:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135590.951923:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de0 expref: 6 pid: 6522 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135590.951959:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de0 expref: 6 pid: 6522 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135590.951987:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee039b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140de0 expref: 6 pid: 6522 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135590.952007:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:2.0:1783135590.952013:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135590.952024:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135590.952032:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135590.952056:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135590.952154:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786037248:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 258us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135590.952161:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 81 00010000:00010000:1.0:1783135590.952742:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.952753:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.952783:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.952795:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.952811:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783135590.953359:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783135590.954286:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.954308:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.954319:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135590.954333:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002901ed6f reply state 00000000f3112257 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.954343:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.955068:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135590.955075:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135590.955080:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783135590.955116:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783135590.955195:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.955203:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.955209:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.955214:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51bc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135590.955231:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.955240:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.955253:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac5424cd900) 00010000:00010000:1.0:1783135590.955256:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135590.955259:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.955265:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135590.955288:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002901ed6f reply state 00000000f3112257 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.955297:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135590.955304:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ac65800cf00) 00010000:00010000:1.0:1783135590.955306:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135590.955308:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783135590.955504:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:12205:x1869752786037120:12345-192.168.204.6@tcp:36:lfs.0 Request processed in 19519us (19676us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1783135590.955515:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 154 00000100:00100000:0.0:1783135591.025605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135591.026324:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786037376 00000100:00100000:1.0:1783135591.026336:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786037376 00000100:00100000:1.0:1783135591.026412:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 155 00000100:00100000:1.0:1783135591.026424:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+15:12213:x1869752786037376:12345-192.168.204.6@tcp:101:lctl.0 00010000:00010000:1.0:1783135591.026448:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135591.026496:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140df5 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.026563:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee03f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.026577:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee03f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.026589:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee03f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135591.026648:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783135591.026652:0:13464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135591.026675:0:13464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee03f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.026712:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee03ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140df5 expref: 17 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.026732:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee03f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140df5 expref: 16 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.026740:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:1.0:1783135591.026742:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135591.026745:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51b800, rc 0) 00000100:00100000:1.0:1783135591.026815:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:12213:x1869752786037376:12345-192.168.204.6@tcp:101:lctl.0 Request processed in 394us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135591.026822:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 155 00000100:00100000:2.0:1783135591.080529:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.080663:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786037504 00000100:00100000:3.0:1783135591.080677:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786037504 00000100:00100000:3.0:1783135591.080753:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 156 00000100:00100000:3.0:1783135591.080765:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+16:12219:x1869752786037504:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1783135591.080797:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135591.080828:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee03fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140dfc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.080924:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0404 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.080942:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.080964:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.080991:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee040b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.080999:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee040b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081028:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee040b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081194:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0412 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081204:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0412 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081211:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0412 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135591.081268:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1783135591.081272:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135591.081297:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0412 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081316:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0404 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081323:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0404 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081334:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0404 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081340:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135591.081347:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0404 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081355:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0404 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081378:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:3.0:1783135591.081381:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135591.081386:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0404 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081393:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081412:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee040b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081419:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee040b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081424:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee040b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081435:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135591.081438:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee040b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081445:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee040b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081451:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ac65800cf00) 00010000:00010000:3.0:1783135591.081453:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135591.081456:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee040b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081462:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee040b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081518:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee03fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dfc expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081534:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0412 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dfc expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.081542:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:3.0:1783135591.081545:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783135591.081547:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640031200, rc 0) 00000100:00100000:3.0:1783135591.081618:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:12219:x1869752786037504:12345-192.168.204.6@tcp:101:bash.0 Request processed in 855us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135591.081626:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 156 00000100:00100000:0.0:1783135591.092533:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135591.092717:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786037760 00000100:00100000:1.0:1783135591.092748:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786037760 00000100:00100000:1.0:1783135591.092827:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 157 00000100:00100000:1.0:1783135591.092838:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:12219:x1869752786037760:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135591.092860:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135591.092880:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee0419 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e03 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.092993:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0420 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.093009:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0420 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.093022:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0420 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.093069:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.093078:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.093113:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783135591.093672:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:1.0:1783135591.100833:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.100858:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.100889:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.100928:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0420 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.100934:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0420 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.100940:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0420 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.100947:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135591.100950:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0420 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.100956:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0420 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.100967:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135591.100970:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135591.100974:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0420 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.100979:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0420 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135591.100992:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003be505fa reply state 00000000453bfb74 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.101002:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.101016:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac65800c300) 00010000:00010000:1.0:1783135591.101019:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135591.101022:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783135591.101059:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee0419 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e03 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.101075:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e03 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.101082:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800cb00) 00010000:00010000:1.0:1783135591.101085:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135591.101126:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a200, rc 0) 00000100:00100000:1.0:1783135591.101923:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12219:x1869752786037760:12345-192.168.204.6@tcp:101:bash.0 Request processed in 9080us (9399us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1783135591.101933:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 157 00000100:00100000:0.0:1783135591.110848:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.111147:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786037888 00000100:00100000:3.0:1783135591.111160:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786037888 00000100:00100000:3.0:1783135591.111252:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1783135591.111265:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752786037888:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1783135591.111290:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135591.111317:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008054436d/0xf7de4ef628ee043c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e0a expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135591.111348:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135591.111375:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=494s v=(0 0) 00010000:00010000:3.0:1783135591.111380:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135591.111390:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008054436d/0xf7de4ef628ee043c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e0a expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.111439:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008054436d/0xf7de4ef628ee043c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e0a expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.111455:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030600, rc 0) 00000100:00100000:3.0:1783135591.112432:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2398:x1869752786037888:12345-192.168.204.6@tcp:101:bash.0 Request processed in 1158us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135591.112445:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00080000:0.0:1783135591.112622:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135591.119805:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.119984:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786038016 00000100:00100000:3.0:1783135591.119998:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786038016 00000100:00100000:3.0:1783135591.120083:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:3.0:1783135591.120142:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6752d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:12219:x1869752786038016:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1783135591.120168:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135591.120202:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e11 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.120243:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008054436d/0xf7de4ef628ee043c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e0a expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.120252:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135591.120257:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135591.120264:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.120310:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008054436d/0xf7de4ef628ee043c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e0a expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.120351:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008054436d/0xf7de4ef628ee043c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e0a expref: 7 pid: 8435 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135591.120369:0:8437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1869752809180672:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135591.126289:0:8437:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135591.127014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.127183:0:8437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1869752809180672:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135591.127226:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.127301:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640031600, rc 0) 00000100:00100000:3.0:1783135591.127392:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6752d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:12219:x1869752786038016:12345-192.168.204.6@tcp:101:bash.0 Request processed in 7254us (7609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135591.127403:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:0.0:1783135591.127983:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786038144 00000100:00100000:0.0:1783135591.127994:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786038144 00010000:00010000:0.0:1783135591.128041:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008054436d/0xf7de4ef628ee043c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e0a expref: 7 pid: 8435 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135591.128129:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:0.0:1783135591.128141:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752786038144:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135591.128162:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135591.128189:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008054436d/0xf7de4ef628ee043c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e0a expref: 7 pid: 8435 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.128204:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008054436d/0xf7de4ef628ee043c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e0a expref: 7 pid: 8435 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.128234:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008054436d/0xf7de4ef628ee043c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e0a expref: 7 pid: 8435 timeout: 594 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.128256:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135591.128262:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135591.128270:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.128303:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.128350:0:10344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135591.128367:0:10344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543adf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10344:1869752809180800:192.168.204.6@tcp:105: 00000100:00100000:0.0:1783135591.128438:0:10344:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac646caae40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135591.134237:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135591.134306:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786038400 00000100:00100000:1.0:1783135591.134320:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786038400 00000100:00100000:2.0:1783135591.134389:0:10344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543adf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10344:1869752809180800:192.168.204.6@tcp:105: 00000100:00100000:1.0:1783135591.134406:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:1.0:1783135591.134417:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12219:x1869752786038400:12345-192.168.204.6@tcp:35:bash.0 00010000:00010000:2.0:1783135591.134420:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135591.134501:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2401:x1869752786038144:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 6361us (7494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135591.134532:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:2.0:1783135591.136485:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:12219:x1869752786038400:12345-192.168.204.6@tcp:35:bash.0 Request processed in 2048us (2243us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1783135591.136500:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:0.0:1783135591.224747:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.226166:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786038656 00000100:00100000:3.0:1783135591.226186:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786038656 00000100:00100000:3.0:1783135591.226275:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 158 00000100:00100000:3.0:1783135591.226289:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:12229:x1869752786038656:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135591.226323:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135591.226351:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee044a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e18 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135591.226743:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783135591.227375:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee044a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e18 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.227414:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:3.0:1783135591.227417:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135591.227424:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee044a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e18 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.227445:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030000, rc 0) 00000100:00100000:3.0:1783135591.228355:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:12229:x1869752786038656:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 2060us (3615us total) trans 4294967422 rc 301/301 00000100:00100000:3.0:1783135591.228368:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 158 00000100:00100000:1.0:1783135591.235246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.235356:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786038912 00000100:00100000:3.0:1783135591.235370:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786038912 00000100:00100000:3.0:1783135591.235448:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:3.0:1783135591.235461:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:12229:x1869752786038912:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135591.235788:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:12229:x1869752786038912:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 328us (557us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1783135591.235797:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 37 00010000:00010000:2.0:1783135591.278681:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135591.316830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135591.316992:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786039040 00000100:00100000:1.0:1783135591.317007:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786039040 00000100:00100000:1.0:1783135591.317148:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 159 00000100:00100000:1.0:1783135591.317163:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:12235:x1869752786039040:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135591.317202:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135591.317234:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e1f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.317348:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee045f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.317366:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee045f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.317381:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee045f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135591.317788:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783135591.317794:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135591.317820:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee045f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.322744:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e1f expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.322784:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee045f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e1f expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.322795:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135591.322798:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135591.322801:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51aa00, rc 0) 00000100:00100000:1.0:1783135591.322912:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:12235:x1869752786039040:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 5751us (6096us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135591.322922:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 159 00000100:00100000:0.0:1783135591.333199:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135591.333319:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786039296 00000100:00100000:1.0:1783135591.333333:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786039296 00000100:00100000:1.0:1783135591.333442:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 160 00000100:00100000:1.0:1783135591.333456:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:12235:x1869752786039296:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135591.333495:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135591.333523:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0466 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e26 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.333676:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee046d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.333705:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee046d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.333721:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee046d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135591.333737:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783135591.333877:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee0466 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e26 expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.333899:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee046d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e26 expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.333908:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800cb00) 00010000:00010000:1.0:1783135591.333911:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135591.333915:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51ba00, rc 0) 00000100:00100000:1.0:1783135591.334000:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+26:12235:x1869752786039296:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 546us (816us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1783135591.334008:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 160 00000100:00100000:2.0:1783135591.338476:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.338876:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786039552 00000100:00100000:3.0:1783135591.338892:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786039552 00000100:00100000:3.0:1783135591.338981:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 161 00000100:00100000:3.0:1783135591.338995:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+26:12235:x1869752786039552:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135591.339030:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135591.339059:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee047b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e2d expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.339241:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0482 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.339278:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0482 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.339292:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0482 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135591.339308:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783135591.341921:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee047b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e2d expref: 29 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.341962:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0482 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e2d expref: 28 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.341972:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800cb00) 00010000:00010000:3.0:1783135591.341975:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783135591.341979:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030e00, rc 0) 00000100:00100000:3.0:1783135591.342163:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+28:12235:x1869752786039552:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 3170us (3709us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1783135591.342174:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 161 00000100:00100000:2.0:1783135591.345509:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.345788:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786039680 00000100:00100000:3.0:1783135591.345804:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786039680 00000100:00100000:3.0:1783135591.345909:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:3.0:1783135591.345924:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+28:2400:x1869752786039680:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135591.345945:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135591.345978:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee046d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e26 expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.346028:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800cb00) 00010000:00010000:3.0:1783135591.346034:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135591.346111:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:2400:x1869752786039680:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 189us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135591.346121:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:2.0:1783135591.359305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.359483:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786039808 00000100:00100000:3.0:1783135591.359510:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786039808 00000100:00100000:2.0:1783135591.359666:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1783135591.359678:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2399:x1869752786039808:12345-192.168.204.6@tcp:1:lfs.0 00010000:00010000:2.0:1783135591.359762:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135591.359790:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135591.359801:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783135591.359806:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135591.359811:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135591.359861:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135591.359878:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 6 pid: 8437 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135591.359927:0:8435:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1869752809180928:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135591.360077:0:8435:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bcea540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135591.367072:0:8435:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1869752809180928:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135591.367160:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135591.369322:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135591.371857:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786039936 00000100:00100000:0.0:1783135591.371880:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786039936 00002000:00100000:0.0:1783135591.371957:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ac67e2a1f80 x1869752786039936/t0(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:7/0 lens 504/0 e 0 to 0 dl 1783135602 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135591.371970:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac67e2a1f80 with x1869752786039936 ext(0->12) 00010000:00010000:0.0:1783135591.371982:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 7 pid: 8437 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.372000:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 7 pid: 8437 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135591.372008:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ac67e2a1f80 00000100:00100000:0.0:1783135591.372149:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:0.0:1783135591.372177:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752786039936:12345-192.168.204.6@tcp:4:lfs.0 00000100:00100000:0.0:1783135591.375172:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2401:x1869752786039936:12345-192.168.204.6@tcp:4:lfs.0 Request processed in 2986us (5848us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783135591.375187:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00002000:00100000:0.0:1783135591.375200:0:8443:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ac67e2a1f80 x1869752786039936/t4294967306(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:7/0 lens 504/448 e 0 to 0 dl 1783135602 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135591.375211:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac67e2a1f80 with x1869752786039936 ext(0->12) 00010000:00010000:0.0:1783135591.375221:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 9 pid: 8437 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.375240:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 9 pid: 8437 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135591.375247:0:8443:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ac67e2a1f80 00000100:00100000:2.0:1783135591.382234:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135591.382337:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786040064 00000100:00100000:0.0:1783135591.382348:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786040064 00010000:00010000:0.0:1783135591.382395:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 9 pid: 8437 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135591.382446:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:0.0:1783135591.382455:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2400:x1869752786040064:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135591.382559:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783135591.382580:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783135591.382583:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1783135591 00002000:00010000:0.0:1783135591.382585:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1783135591 00002000:00010000:0.0:1783135591.382603:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1783135591 00002000:00010000:0.0:1783135591.382605:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1783135591.382612:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 9 pid: 8437 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.382628:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 9 pid: 8437 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.382656:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a78af296/0xf7de4ef628ee0443 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e11 expref: 9 pid: 8437 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.382674:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135591.382678:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135591.382684:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.382693:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135591.382727:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135591.383115:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.383127:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.383150:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.383159:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.383167:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.383186:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908000 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135591.383191:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.383200:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.383219:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.383227:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee0490 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135591.383341:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786040064:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 886us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135591.383351:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:3.0:1783135591.384236:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2399:x1869752786039808:12345-192.168.204.6@tcp:1:lfs.0 Request processed in 24554us (24942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135591.384248:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:1.0:1783135591.402011:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.402622:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786040320 00000100:00100000:3.0:1783135591.402635:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786040320 00000100:00100000:3.0:1783135591.402692:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:3.0:1783135591.402702:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:12235:x1869752786040320:12345-192.168.204.6@tcp:35:lfs.0 00000004:00010000:3.0:1783135591.402770:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0482 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e2d expref: 27 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135591.403001:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1783135591.403030:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:3.0:1783135591.403369:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:3.0:1783135591.403407:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.403422:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e03 expref: 31 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.403431:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.403479:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e03 expref: 31 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.403495:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e03 expref: 31 pid: 6524 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135591.403658:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1869752809181056:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135591.403743:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135591.416709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135591.417143:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786040448 00000100:00100000:1.0:1783135591.417155:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786040448 00010000:00010000:1.0:1783135591.417208:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e03 expref: 32 pid: 6524 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135591.417254:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 84 00000100:00100000:1.0:1783135591.417265:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:2400:x1869752786040448:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135591.417280:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135591.417287:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e03 expref: 32 pid: 6524 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.417301:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e03 expref: 32 pid: 6524 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.417323:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800cb00) 00010000:00010000:1.0:1783135591.417328:0:10346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.417337:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.417344:0:10346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.417362:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135591.417413:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:2400:x1869752786040448:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 150us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135591.417422:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 84 00010000:00010000:3.0:1783135591.417616:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee042e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e03 expref: 31 pid: 6524 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135591.417638:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1869752809181056:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135591.417661:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.417670:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.417677:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135591.418051:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:3.0:1783135591.418226:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1783135591.418312:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869752809181184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783135591.418371:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135591.418401:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135591.418495:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809181184 00000100:00100000:0.0:1783135591.418506:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809181184 00000100:00100000:0.0:1783135591.418558:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1783135591.418566:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1869752809181184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783135591.418656:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1869752809181184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135591.418663:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1783135591.418696:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869752809181184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783135591.419075:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:0.0:1783135591.419161:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869752809181312:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783135591.419196:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135591.419213:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354300 going to sleep for 11 seconds 00000100:00080000:3.0:1783135591.419738:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135591.419982:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809181312 00000100:00100000:1.0:1783135591.420000:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809181312 00000100:00100000:1.0:1783135591.420043:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783135591.420052:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1869752809181312:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783135591.420226:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6526:x1869752809181312:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 174us (1028us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783135591.420234:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783135591.421016:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869752809181312:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1783135591.421081:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1783135591.421146:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.421157:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.421165:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.421171:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135591.421176:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.421184:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.421200:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800cb00) 00010000:00010000:3.0:1783135591.421203:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783135591.421208:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.421214:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee0497 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135591.421333:0:6526:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783135591.421394:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1783135591.421406:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 495214317659ns, next at 496214315424ns, rc = 0 00000001:00080000:3.0:1783135591.421411:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:3.0:1783135591.421431:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800cb00) 00010000:00010000:3.0:1783135591.421434:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783135591.421440:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0482 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e2d expref: 35 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135591.422762:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+34:12235:x1869752786040320:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 20051us (20753us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1783135591.422788:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00000020:00080000:3.0:1783135591.422794:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783135591.441933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135591.442938:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786040576 00000100:00100000:1.0:1783135591.442953:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786040576 00000100:00100000:1.0:1783135591.443067:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 162 00000100:00100000:1.0:1783135591.443078:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+34:12235:x1869752786040576:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135591.443148:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135591.443175:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee049e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e34 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.443234:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee049e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e34 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.443249:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee049e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e34 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.443270:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135591.443272:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135591.443276:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51bc00, rc 0) 00000100:00100000:1.0:1783135591.443332:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:12235:x1869752786040576:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 255us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135591.443338:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 162 00000100:00100000:1.0:1783135591.455311:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135591.456530:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786040832 00000100:00100000:2.0:1783135591.456544:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786040832 00000100:00100000:2.0:1783135591.456624:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:2.0:1783135591.456638:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:12235:x1869752786040832:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1783135591.456910:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+36:12235:x1869752786040832:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 275us (2107us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1783135591.456918:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:0.0:1783135591.591549:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.591904:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786041088 00000100:00100000:3.0:1783135591.591915:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786041088 00000100:00100000:3.0:1783135591.591980:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 163 00000100:00100000:3.0:1783135591.591991:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+36:12245:x1869752786041088:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135591.592016:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135591.592037:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee04a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e3b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135591.592171:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783135591.592273:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee04a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e3b expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.592288:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:3.0:1783135591.592305:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135591.592312:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee04a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e3b expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.592329:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030e00, rc 0) 00000100:00100000:3.0:1783135591.592456:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:12245:x1869752786041088:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 466us (916us total) trans 4294967436 rc 301/301 00000100:00100000:3.0:1783135591.592473:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 163 00000100:00100000:0.0:1783135591.596952:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.597035:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786041216 00000100:00100000:3.0:1783135591.597045:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786041216 00000100:00100000:3.0:1783135591.597253:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 164 00000100:00100000:3.0:1783135591.597264:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:12245:x1869752786041216:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:3.0:1783135591.597341:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee04b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597472:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee04b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597488:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee04b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597510:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597519:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597525:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597612:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597721:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597729:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135591.597782:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597796:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee04b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597802:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee04b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597808:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee04b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597814:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135591.597819:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee04b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597827:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee04b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597839:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:3.0:1783135591.597842:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135591.597846:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee04b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597852:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee04b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597875:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597881:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597887:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597892:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135591.597895:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597900:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597907:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac65800c300) 00010000:00010000:3.0:1783135591.597910:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135591.597913:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597918:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597927:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597933:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597939:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597951:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640030600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135591.597954:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597960:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597968:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:3.0:1783135591.597970:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135591.597973:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.597978:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135591.598196:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:12245:x1869752786041216:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 933us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135591.598205:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 164 00000100:00100000:0.0:1783135591.601692:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135591.601795:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786041472 00000100:00100000:2.0:1783135591.601805:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786041472 00000100:00100000:2.0:1783135591.601893:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:2.0:1783135591.601905:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:12245:x1869752786041472:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1783135591.602183:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:12245:x1869752786041472:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 280us (561us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1783135591.602191:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:0.0:1783135591.652853:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135591.652959:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786041728 00000100:00100000:1.0:1783135591.652971:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786041728 00000100:00100000:1.0:1783135591.653037:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 165 00000100:00100000:1.0:1783135591.653049:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:12248:x1869752786041728:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135591.653074:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135591.653136:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee04c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e42 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653236:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee04cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653251:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee04cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653263:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee04cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653274:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee04d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653281:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee04d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653288:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee04d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653396:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653405:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653424:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135591.653435:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783135591.653540:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee04cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653548:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee04cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653554:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee04cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653561:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135591.653565:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee04cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653572:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee04cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653585:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135591.653588:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135591.653593:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee04cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653598:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a200/0xf7de4ef628ee04cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653611:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee04d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653617:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee04d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653630:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee04d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653635:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51ba00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135591.653638:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee04d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653644:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee04d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653653:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac65800c300) 00010000:00010000:1.0:1783135591.653656:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135591.653659:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee04d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653665:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51ba00/0xf7de4ef628ee04d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653705:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a400/0xf7de4ef628ee04c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e42 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653718:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e42 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.653725:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135591.653727:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135591.653729:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c51a800, rc 0) 00000100:00100000:1.0:1783135591.653785:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+40:12248:x1869752786041728:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 738us (943us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1783135591.653803:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 165 00000100:00100000:0.0:1783135591.659458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135591.659665:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786041856 00000100:00100000:1.0:1783135591.659676:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786041856 00000100:00100000:1.0:1783135591.659745:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 166 00000100:00100000:1.0:1783135591.659757:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+40:12248:x1869752786041856:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:1.0:1783135591.659825:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee04eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.659843:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee04eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.659853:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee04eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.659889:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee04eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.659897:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee04eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.659903:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee04eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.659909:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135591.659914:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee04eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.659920:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee04eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.659931:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135591.659948:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135591.659953:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee04eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135591.659959:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee04eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135591.660038:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+40:12248:x1869752786041856:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 282us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135591.660046:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 166 00000100:00100000:0.0:1783135591.662568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.662657:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786042112 00000100:00100000:3.0:1783135591.662668:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786042112 00000100:00100000:3.0:1783135591.662727:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:3.0:1783135591.662737:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+40:12248:x1869752786042112:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135591.662974:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+41:12248:x1869752786042112:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 238us (414us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1783135591.662982:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:3.0:1783135591.790426:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135591.790454:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809181440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135591.790556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135591.790761:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809181440 00000100:00100000:0.0:1783135591.790768:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809181440 00000100:00100000:0.0:1783135591.790845:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1783135591.790855:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809181440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135591.790893:0:13344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135591.790951:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809181440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135591.790958:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783135591.791043:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809181440:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135591.997979:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135591.999626:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786042368 00000100:00100000:3.0:1783135591.999641:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786042368 00000100:00100000:3.0:1783135591.999723:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 167 00000100:00100000:3.0:1783135591.999734:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+41:12279:x1869752786042368:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:3.0:1783135591.999762:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135591.999784:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e49 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.999910:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.999926:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135591.999938:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135591.999949:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783135592.000062:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee04f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e49 expref: 44 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.000084:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e49 expref: 43 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.000154:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:3.0:1783135592.000157:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135592.000160:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640031600, rc 0) 00000100:00100000:3.0:1783135592.000240:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:12279:x1869752786042368:12345-192.168.204.6@tcp:101:cat.0 Request processed in 508us (2269us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1783135592.000262:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 167 00000100:00100000:0.0:1783135592.012126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135592.012215:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786042624 00000100:00100000:3.0:1783135592.012226:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786042624 00000100:00100000:3.0:1783135592.012310:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:3.0:1783135592.012320:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:12279:x1869752786042624:12345-192.168.204.6@tcp:35:cat.0 00000100:00100000:3.0:1783135592.012645:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+44:12279:x1869752786042624:12345-192.168.204.6@tcp:35:cat.0 Request processed in 325us (554us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1783135592.012652:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00080000:0.0:1783135592.013517:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135592.013910:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135592.014059:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786042752 00000100:00100000:1.0:1783135592.014067:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786042752 00000100:00100000:1.0:1783135592.014315:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1783135592.014325:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6618edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+44:2398:x1869752786042752:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135592.014342:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135592.014382:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee04f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e49 expref: 44 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.014403:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135592.014408:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135592.014473:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6618edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:2398:x1869752786042752:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 149us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135592.014480:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1783135592.094866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135592.094955:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786043008 00000100:00100000:3.0:1783135592.094966:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786043008 00000100:00100000:3.0:1783135592.095028:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 168 00000100:00100000:3.0:1783135592.095038:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:12286:x1869752786043008:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:3.0:1783135592.095064:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135592.095066:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783135592.095145:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51aa00/0xf7de4ef628ee045f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e1f expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.095166:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:3.0:1783135592.095171:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135592.095186:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0507 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e50 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.095285:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.095299:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e42 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.095321:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.095365:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e42 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.095378:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e42 expref: 43 pid: 6523 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135592.095393:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809181568:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135592.095517:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135592.101913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135592.102013:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786043136 00000100:00100000:2.0:1783135592.102022:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786043136 00010000:00010000:2.0:1783135592.102064:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e42 expref: 44 pid: 6523 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135592.102170:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 85 00000100:00100000:2.0:1783135592.102180:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+44:2401:x1869752786043136:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135592.102199:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135592.102206:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e42 expref: 44 pid: 6523 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.102218:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e42 expref: 44 pid: 6523 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.102240:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:2.0:1783135592.102245:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.102255:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.102262:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.102282:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135592.102351:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+44:2401:x1869752786043136:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 172us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135592.102360:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 85 00010000:00010000:3.0:1783135592.102673:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a800/0xf7de4ef628ee04dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e42 expref: 43 pid: 6523 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135592.102692:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809181568:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135592.102714:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.102723:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.102729:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135592.102748:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783135592.102872:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0507 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e50 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.102903:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e50 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.102910:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:3.0:1783135592.102913:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135592.102916:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030000, rc 0) 00000100:00100000:3.0:1783135592.104683:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:12286:x1869752786043008:12345-192.168.204.6@tcp:101:dd.0 Request processed in 9636us (9817us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1783135592.104696:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 168 00000100:00100000:0.0:1783135592.112224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135592.112412:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786043264 00000100:00100000:3.0:1783135592.112423:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786043264 00000100:00100000:3.0:1783135592.112587:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 169 00000100:00100000:3.0:1783135592.112598:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:12286:x1869752786043264:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:3.0:1783135592.112744:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135592.112768:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee051c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e57 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.112806:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.112822:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.112833:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.112968:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee051c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e57 expref: 45 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.112999:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e57 expref: 44 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.113007:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:3.0:1783135592.113010:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135592.113014:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac640030e00, rc 0) 00000100:00100000:3.0:1783135592.113420:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+44:12286:x1869752786043264:12345-192.168.204.6@tcp:101:dd.0 Request processed in 822us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135592.113429:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 169 00000100:00100000:2.0:1783135592.121659:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135592.121758:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786043520 00000100:00100000:1.0:1783135592.121769:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786043520 00000100:00100000:1.0:1783135592.121837:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 170 00000100:00100000:1.0:1783135592.121847:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+44:12286:x1869752786043520:12345-192.168.204.6@tcp:36:dd.0 00010000:00010000:1.0:1783135592.122138:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.122156:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.122168:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135592.122214:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1783135592.122238:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f268a2a4 reply state 00000000d988f2b9 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.122251:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.122259:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135592.122262:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135592.122265:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135592.122357:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+47:12286:x1869752786043520:12345-192.168.204.6@tcp:36:dd.0 Request processed in 510us (707us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1783135592.122365:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 170 00000020:00080000:1.0:1783135592.122370:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783135592.302516:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135592.378240:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135592.378341:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786043648 00000100:00100000:3.0:1783135592.378352:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786043648 00000100:00100000:3.0:1783135592.378473:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 171 00000100:00100000:3.0:1783135592.378485:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+47:12300:x1869752786043648:12345-192.168.204.6@tcp:101:stat.0 00010000:00010000:3.0:1783135592.378509:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135592.378531:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0531 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e5e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.378603:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0538 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.378618:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0538 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.378641:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0538 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.378653:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee053f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.378674:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee053f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.378682:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee053f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.378973:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.378986:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e50 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.378994:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.379027:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e50 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.379228:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e50 expref: 48 pid: 6522 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135592.379245:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809181696:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135592.386310:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135592.391828:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135592.392053:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786043904 00000100:00100000:3.0:1783135592.392063:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786043904 00000100:00100000:3.0:1783135592.392135:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:3.0:1783135592.392146:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+49:6173:x1869752786043904:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783135592.392439:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+50:6173:x1869752786043904:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 294us (620us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1783135592.392477:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:2.0:1783135592.393690:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809181696:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135592.393734:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135592.395974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135592.396695:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786044032 00000100:00100000:1.0:1783135592.396707:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786044032 00010000:00010000:1.0:1783135592.396755:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e50 expref: 50 pid: 6522 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135592.397243:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 86 00000100:00100000:1.0:1783135592.397272:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+50:2401:x1869752786044032:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135592.397290:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135592.397298:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e50 expref: 50 pid: 6522 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.397314:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e50 expref: 50 pid: 6522 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.397338:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030000/0xf7de4ef628ee050e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e50 expref: 50 pid: 6522 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.397358:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135592.397363:0:10346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.397374:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.397382:0:10346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.397413:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135592.397706:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397716:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135592.397777:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783135592.397782:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135592.397812:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397826:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397838:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0538 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397846:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0538 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397852:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0538 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397870:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135592.397875:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0538 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397884:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0538 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397894:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:3.0:1783135592.397906:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135592.397912:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0538 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397919:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031600/0xf7de4ef628ee0538 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397933:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee053f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397938:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee053f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397943:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee053f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397948:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135592.397950:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee053f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397956:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee053f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397962:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac65800c300) 00010000:00010000:3.0:1783135592.397964:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135592.397967:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee053f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.397973:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee053f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.398005:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030600/0xf7de4ef628ee0531 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e5e expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.398031:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e5e expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.398281:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:3.0:1783135592.398283:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135592.398285:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e800, rc 0) 00000100:00100000:1.0:1783135592.398371:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+49:2401:x1869752786044032:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 1100us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135592.398380:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 86 00000100:00100000:3.0:1783135592.398774:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+48:12300:x1869752786043648:12345-192.168.204.6@tcp:101:stat.0 Request processed in 20290us (20542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135592.398783:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 171 00000100:00100000:3.0:1783135592.512859:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135592.512982:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786044288 00000100:00100000:2.0:1783135592.512993:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786044288 00000100:00100000:2.0:1783135592.513073:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 172 00000100:00100000:2.0:1783135592.513084:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+48:12306:x1869752786044288:12345-192.168.204.6@tcp:36:truncate.0 00010000:00010000:2.0:1783135592.513178:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135592.513216:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0546 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e5e expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.513238:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:2.0:1783135592.513242:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135592.513428:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.513458:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.513470:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135592.513512:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:2.0:1783135592.513535:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006df2e4a3 reply state 000000002662a06e transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.513548:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.513556:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:2.0:1783135592.513558:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135592.513569:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135592.513685:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+50:12306:x1869752786044288:12345-192.168.204.6@tcp:36:truncate.0 Request processed in 602us (835us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1783135592.513693:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 172 00000020:00080000:2.0:1783135592.513698:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783135592.754839:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135592.758107:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786044416 00000100:00100000:0.0:1783135592.758125:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786044416 00000100:00100000:0.0:1783135592.758220:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 173 00000100:00100000:0.0:1783135592.758247:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+50:12320:x1869752786044416:12345-192.168.204.6@tcp:101:stat.0 00010000:00010000:0.0:1783135592.758273:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135592.758299:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee0554 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e65 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758405:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee055b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758422:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee055b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758435:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee055b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758455:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0562 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758462:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758468:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758563:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758573:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758599:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135592.758648:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1783135592.758653:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135592.758675:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758688:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758696:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee055b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758702:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee055b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758708:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee055b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758714:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135592.758718:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee055b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758726:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee055b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758737:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:0.0:1783135592.758739:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135592.758744:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee055b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758759:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee055b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758782:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0562 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758788:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0562 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758793:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0562 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758798:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135592.758801:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0562 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758807:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0562 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758816:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac65800c300) 00010000:00010000:0.0:1783135592.758819:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135592.758822:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0562 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.758828:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0562 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.759225:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee0554 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e65 expref: 52 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.759242:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e65 expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.759256:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:0.0:1783135592.759258:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135592.759260:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988000, rc 0) 00000100:00100000:0.0:1783135592.759338:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+51:12320:x1869752786044416:12345-192.168.204.6@tcp:101:stat.0 Request processed in 1107us (4508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135592.759346:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 173 00000100:00100000:3.0:1783135592.861639:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135592.861716:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786044672 00000100:00100000:2.0:1783135592.861728:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786044672 00000100:00100000:2.0:1783135592.861804:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 174 00000100:00100000:2.0:1783135592.861815:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+51:12330:x1869752786044672:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135592.861838:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135592.861932:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee0570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e6c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135592.862052:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1783135592.862204:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee0570 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e6c expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.862221:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:2.0:1783135592.862225:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135592.862229:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee0570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e6c expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.862243:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908200, rc 0) 00000100:00100000:2.0:1783135592.862377:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:12330:x1869752786044672:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 563us (759us total) trans 4294967448 rc 301/301 00000100:00100000:2.0:1783135592.862385:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 174 00000100:00100000:1.0:1783135592.868386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135592.868486:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786044928 00000100:00100000:3.0:1783135592.868497:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786044928 00000100:00100000:3.0:1783135592.868595:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:3.0:1783135592.868606:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660a8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:12330:x1869752786044928:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135592.869029:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660a8e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+53:12330:x1869752786044928:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 423us (652us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1783135592.869037:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:1.0:1783135592.935531:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135592.935651:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786045184 00000100:00100000:0.0:1783135592.935662:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786045184 00000100:00100000:0.0:1783135592.935724:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 175 00000100:00100000:0.0:1783135592.935735:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+53:12336:x1869752786045184:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1783135592.935761:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135592.935786:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee057e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e73 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.935911:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.935930:0:13464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e65 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.935940:0:13464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.935981:0:13464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e65 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.935994:0:13464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e65 expref: 54 pid: 6523 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135592.936025:0:13464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13464:1869752809181824:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135592.936176:0:13464:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6580a1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135592.941704:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135592.941907:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786045312 00000100:00100000:3.0:1783135592.941919:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786045312 00010000:00010000:3.0:1783135592.941965:0:10345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e65 expref: 55 pid: 6523 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135592.942015:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 87 00000100:00100000:3.0:1783135592.942026:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+55:2400:x1869752786045312:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135592.942058:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135592.942066:0:10345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e65 expref: 55 pid: 6523 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.942082:0:10345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e65 expref: 55 pid: 6523 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.942165:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:3.0:1783135592.942170:0:10345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.942183:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.942191:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.942217:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135592.942276:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+55:2400:x1869752786045312:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 251us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135592.942285:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 87 00010000:00010000:1.0:1783135592.943745:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0569 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e65 expref: 54 pid: 6523 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135592.943787:0:13464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13464:1869752809181824:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135592.943817:0:13464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.943828:0:13464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.943834:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135592.943856:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1783135592.944005:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee057e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e73 expref: 55 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.944021:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e73 expref: 54 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.944029:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135592.944032:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135592.944035:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989000, rc 0) 00000100:00100000:1.0:1783135592.944223:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:12336:x1869752786045184:12345-192.168.204.6@tcp:101:bash.0 Request processed in 8488us (8701us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1783135592.944232:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 175 00000100:00100000:0.0:1783135592.951062:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135592.955899:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786045568 00000100:00100000:3.0:1783135592.955919:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786045568 00000100:00100000:3.0:1783135592.956012:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 176 00000100:00100000:3.0:1783135592.956023:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:12336:x1869752786045568:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:3.0:1783135592.956312:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.956538:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.956568:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135592.956617:0:8461:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:3.0:1783135592.956645:0:8461:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004943bda2 reply state 00000000761a9736 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.956660:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.956668:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:3.0:1783135592.956671:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135592.956675:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135592.956795:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+57:12336:x1869752786045568:12345-192.168.204.6@tcp:36:bash.0 Request processed in 772us (5741us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1783135592.956802:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 176 00000020:00080000:3.0:1783135592.956808:0:8461:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783135592.961711:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135592.961847:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786045696 00000100:00100000:3.0:1783135592.961858:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786045696 00000100:00100000:3.0:1783135592.961927:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 177 00000100:00100000:3.0:1783135592.961938:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+57:12336:x1869752786045696:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1783135592.961965:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135592.961988:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee059a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e7a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.962145:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.962161:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e73 expref: 58 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.962177:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.962212:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e73 expref: 58 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.962226:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e73 expref: 58 pid: 13464 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135592.962241:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543ad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809181952:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135592.962334:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135592.964313:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543ad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809181952:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135592.964352:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135592.969307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135592.969709:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786045824 00000100:00100000:2.0:1783135592.969721:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786045824 00010000:00010000:2.0:1783135592.969782:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e73 expref: 59 pid: 13464 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135592.969829:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:2.0:1783135592.969839:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:2400:x1869752786045824:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135592.969855:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135592.969862:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e73 expref: 59 pid: 13464 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.969874:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e73 expref: 59 pid: 13464 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.969900:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0585 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e73 expref: 59 pid: 13464 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.969919:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:2.0:1783135592.969925:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.969936:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.969944:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.969979:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135592.970044:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+58:2400:x1869752786045824:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 205us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135592.970052:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 88 00010000:00010000:3.0:1783135592.970194:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.970203:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135592.970258:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783135592.970264:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135592.970287:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.970317:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee059a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e7a expref: 58 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.970361:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e7a expref: 57 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.970368:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:3.0:1783135592.970371:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135592.970374:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e000, rc 0) 00000100:00100000:3.0:1783135592.970402:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+57:12336:x1869752786045696:12345-192.168.204.6@tcp:101:bash.0 Request processed in 8466us (8704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135592.970408:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 177 00000100:00100000:2.0:1783135592.974352:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135592.974516:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786046080 00000100:00100000:1.0:1783135592.974526:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786046080 00000100:00100000:1.0:1783135592.974602:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:1.0:1783135592.974614:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+57:12336:x1869752786046080:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:1.0:1783135592.974871:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+58:12336:x1869752786046080:12345-192.168.204.6@tcp:35:bash.0 Request processed in 258us (530us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1783135592.974879:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:0.0:1783135593.022929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135593.022975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135593.023013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135593.023048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135593.023078:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786046208 00000100:00100000:0.0:1783135593.023118:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786046208 00000100:00100000:0.0:1783135593.023171:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 399 00000100:00100000:0.0:1783135593.023182:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752786046208:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135593.023262:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752786046208:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 81us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135593.023270:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 399 00000100:00100000:0.0:1783135593.023317:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135593.023700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135593.023849:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786046592 00000100:00100000:3.0:1783135593.023855:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786046592 00000100:00100000:3.0:1783135593.023905:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786046464 00000100:00100000:3.0:1783135593.023909:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786046464 00000100:00100000:3.0:1783135593.023934:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:3.0:1783135593.023942:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786046592:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135593.023985:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786046592:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 44us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.023992:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:3.0:1783135593.024007:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 105 00000100:00100000:3.0:1783135593.024014:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752786046464:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135593.024040:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752786046464:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.024046:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 105 00000100:00100000:3.0:1783135593.024072:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786046336 00000100:00100000:3.0:1783135593.024117:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786046336 00000100:00100000:3.0:1783135593.024147:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786046848 00000100:00100000:3.0:1783135593.024150:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786046848 00000100:00100000:3.0:1783135593.024168:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786046720 00000100:00100000:3.0:1783135593.024170:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786046720 00000100:00100000:3.0:1783135593.024186:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 368 00000100:00100000:3.0:1783135593.024192:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786046336:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135593.024224:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786046336:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 32us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.024231:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 368 00000100:00100000:3.0:1783135593.024243:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 369 00000100:00100000:3.0:1783135593.024249:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6750d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786046848:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135593.024271:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6750d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786046848:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 23us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.024277:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 369 00000100:00100000:3.0:1783135593.024288:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 370 00000100:00100000:3.0:1783135593.024294:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786046720:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135593.024316:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786046720:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 22us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.024322:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 370 00000100:00080000:0.0:1783135593.024403:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135593.024407:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135593.024410:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135593.024412:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135593.070958:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135593.071050:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786047104 00000100:00100000:3.0:1783135593.071061:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786047104 00000100:00100000:3.0:1783135593.071152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 178 00000100:00100000:3.0:1783135593.071163:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+58:12346:x1869752786047104:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135593.071190:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135593.071214:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee05a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e81 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135593.071358:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1783135593.071492:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee05a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e81 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.071508:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:3.0:1783135593.071512:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135593.071518:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee05a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e81 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.071534:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f400, rc 0) 00000100:00100000:3.0:1783135593.071618:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:12346:x1869752786047104:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 456us (668us total) trans 4294967454 rc 301/301 00000100:00100000:3.0:1783135593.071626:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 178 00000100:00100000:2.0:1783135593.075807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135593.075963:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786047232 00000100:00100000:3.0:1783135593.075974:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786047232 00000100:00100000:3.0:1783135593.076047:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 179 00000100:00100000:3.0:1783135593.076057:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:12346:x1869752786047232:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:3.0:1783135593.076191:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee05b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076212:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee05b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076224:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee05b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076237:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee05bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076263:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee05bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076270:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee05bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076375:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076385:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076392:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135593.076455:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076479:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee05b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076486:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee05b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076493:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee05b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076500:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135593.076504:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee05b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076512:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee05b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076534:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:3.0:1783135593.076538:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135593.076544:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee05b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076550:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee05b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076576:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee05bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076582:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee05bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076587:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee05bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076592:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135593.076595:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee05bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076601:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee05bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076608:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac65800c300) 00010000:00010000:3.0:1783135593.076611:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135593.076614:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee05bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076619:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee05bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076638:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076644:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076649:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076654:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135593.076657:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076663:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076671:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:3.0:1783135593.076673:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135593.076675:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.076681:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee05c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135593.077235:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:12346:x1869752786047232:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 1176us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.077245:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 179 00000100:00100000:1.0:1783135593.081675:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135593.081964:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786047488 00000100:00100000:2.0:1783135593.081973:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786047488 00000100:00100000:2.0:1783135593.082032:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:2.0:1783135593.082042:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:12346:x1869752786047488:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1783135593.082307:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+60:12346:x1869752786047488:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 264us (641us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1783135593.082315:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:2.0:1783135593.129310:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135593.129582:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786047744 00000100:00100000:1.0:1783135593.129592:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786047744 00000100:00100000:1.0:1783135593.129666:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 180 00000100:00100000:1.0:1783135593.129677:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+60:12349:x1869752786047744:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135593.129703:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135593.129726:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee05cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e88 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.129800:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee05d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.129815:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee05d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.129826:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee05d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.129835:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee05d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.129842:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee05d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.129848:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee05d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.129973:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee05e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.129984:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee05e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.129991:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee05e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135593.130000:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783135593.130080:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee05d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130138:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee05d2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130145:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee05d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130150:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135593.130154:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee05d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130161:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee05d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130172:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135593.130175:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135593.130179:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee05d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130195:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee05d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130211:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee05d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130217:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee05d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130222:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee05d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130227:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135593.130230:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee05d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130235:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee05d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.130243:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac65800c300) 00010000:00010000:1.0:1783135593.130246:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135593.130249:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee05d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.131391:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee05d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.131597:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee05cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e88 expref: 63 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.131636:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee05e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e88 expref: 62 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.131644:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135593.131646:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135593.131649:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e8a00, rc 0) 00000100:00100000:1.0:1783135593.131856:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:12349:x1869752786047744:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 2179us (2554us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1783135593.131865:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 180 00000100:00100000:1.0:1783135593.136153:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135593.136196:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135593.136270:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786048000 00000100:00100000:0.0:1783135593.136280:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786048000 00000100:00100000:0.0:1783135593.136357:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 181 00000100:00100000:0.0:1783135593.136367:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:12349:x1869752786048000:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:0.0:1783135593.136445:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.136463:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.136488:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.136529:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.136537:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.136544:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.136550:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135593.136554:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.136561:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.136573:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:0.0:1783135593.136576:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135593.136580:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.136597:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135593.136693:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:12349:x1869752786048000:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 326us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135593.136701:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 181 00000100:00100000:2.0:1783135593.137443:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786047872 00000100:00100000:2.0:1783135593.137451:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786047872 00000100:00100000:2.0:1783135593.137513:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:2.0:1783135593.137522:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:2400:x1869752786047872:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135593.137536:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135593.137560:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee05e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e88 expref: 62 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.137577:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:2.0:1783135593.137581:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135593.137628:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:2400:x1869752786047872:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 107us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135593.137635:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:1.0:1783135593.145936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135593.146066:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786048256 00000100:00100000:2.0:1783135593.146077:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786048256 00000100:00100000:2.0:1783135593.146448:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:2.0:1783135593.146461:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:12349:x1869752786048256:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1783135593.146756:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:12349:x1869752786048256:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 297us (834us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1783135593.146765:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00010000:00010000:3.0:1783135593.327311:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135593.363793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135593.364603:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786048512 00000100:00100000:0.0:1783135593.364713:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786048512 00000100:00100000:0.0:1783135593.364795:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 182 00000100:00100000:0.0:1783135593.364808:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:12367:x1869752786048512:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:0.0:1783135593.364839:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135593.364866:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e8f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.365008:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee05fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.365025:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee05fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.365037:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee05fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135593.365050:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783135593.366226:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee05f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e8f expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.366257:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee05fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e8f expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.366282:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:0.0:1783135593.366284:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783135593.366287:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988800, rc 0) 00000100:00100000:0.0:1783135593.366374:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+64:12367:x1869752786048512:12345-192.168.204.6@tcp:101:cat.0 Request processed in 1568us (2595us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1783135593.366387:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 182 00000001:00080000:0.0:1783135593.376714:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:0.0:1783135593.376791:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:2.0:1783135593.376874:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.376887:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.376896:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.376902:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135593.376907:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.376915:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.376935:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ac65800cf00) 00010000:00010000:2.0:1783135593.376940:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135593.376945:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.376951:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b200/0xf7de4ef628ee03e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.376973:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.376980:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377001:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377006:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135593.377009:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377015:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377023:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:2.0:1783135593.377025:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135593.377028:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377034:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b400/0xf7de4ef628ee03e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377050:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377056:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377061:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377065:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51a000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135593.377067:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377082:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377130:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac65800c300) 00010000:00010000:2.0:1783135593.377132:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135593.377135:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377141:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51a000/0xf7de4ef628ee0427 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377157:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377163:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377169:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377173:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135593.377176:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377181:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377189:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:2.0:1783135593.377191:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135593.377193:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377209:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee052a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377220:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377225:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377231:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377235:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135593.377238:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377243:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377251:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:2.0:1783135593.377253:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135593.377256:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377261:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee054d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377270:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377276:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377287:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377293:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135593.377296:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377301:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377309:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:2.0:1783135593.377311:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135593.377314:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.377332:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0593 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783135593.382606:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ac646caa0c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1783135593.382616:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac647edc200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ac646caae40 00000020:00080000:0.0:1783135593.382619:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac647edc400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac54427dc00 00000100:00100000:3.0:1783135593.383290:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135593.383333:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809182080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783135593.383413:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1783135593.383524:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1783135593.383598:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1783135593.383907:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809182080 00000100:00100000:1.0:1783135593.383915:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809182080 00000100:00100000:1.0:1783135593.383995:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135593.384005:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1869752809182080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783135593.384034:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1783135593.384066:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a487d67, atime: 0x6a487d67, ctime: 0x6a487d67, blocks: 0x8 00010000:00010000:1.0:1783135593.384074:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee060a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.384116:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=497s v=(0 0) 00010000:00010000:1.0:1783135593.384121:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135593.384128:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee060a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.384161:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee060a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.384173:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee060a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.384181:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee060a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.384203:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135593.384281:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135593.384474:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee060a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.384486:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8c00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135593.384492:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee060a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.384502:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee060a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783135593.384532:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783135593.384534:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee060a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.384544:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee060a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135593.384592:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135593.384594:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135593.384596:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135593.384729:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3649:x1869752809182080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 725us (1315us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783135593.384738:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:3.0:1783135593.389955:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac544174e00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1783135593.389979:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809182080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783135593.400426:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135593.400560:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786048640 00000100:00100000:1.0:1783135593.400569:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786048640 00000100:00100000:1.0:1783135593.400640:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 183 00000100:00100000:1.0:1783135593.400650:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:12368:x1869752786048640:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135593.400678:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135593.400701:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0611 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e96 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.400798:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee0618 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.400814:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee0618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.401169:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee0618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135593.401233:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783135593.401237:0:13464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135593.401260:0:13464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee0618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.401291:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0611 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e96 expref: 20 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.401310:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee0618 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e96 expref: 19 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.401319:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135593.401321:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135593.401325:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e8a00, rc 0) 00000100:00100000:1.0:1783135593.401396:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12368:x1869752786048640:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 746us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135593.401403:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 183 00000100:00100000:1.0:1783135593.421132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135593.421259:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786049024 00000100:00100000:3.0:1783135593.421268:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786049024 00000100:00100000:3.0:1783135593.421335:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:3.0:1783135593.421345:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12368:x1869752786049024:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135593.421668:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12368:x1869752786049024:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 324us (546us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1783135593.421676:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:3.0:1783135593.437897:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135593.438255:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786049152 00000100:00100000:1.0:1783135593.438266:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786049152 00000100:00100000:1.0:1783135593.438343:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:1.0:1783135593.438353:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12368:x1869752786049152:12345-192.168.204.6@tcp:103:lfs.0 00010000:00010000:1.0:1783135593.438369:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783135593.438393:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee05a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e7a expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.438445:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee05fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e8f expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.438474:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51bc00/0xf7de4ef628ee049e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e34 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135593.438487:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135593.438492:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135593.438551:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:12368:x1869752786049152:12345-192.168.204.6@tcp:103:lfs.0 Request processed in 200us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135593.438558:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:0.0:1783135593.450375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135593.450488:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786049280 00000100:00100000:3.0:1783135593.450500:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786049280 00000100:00100000:3.0:1783135593.450568:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 184 00000100:00100000:3.0:1783135593.450579:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:12368:x1869752786049280:12345-192.168.204.6@tcp:58:lfs.0 00010000:00010000:3.0:1783135593.450703:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee061f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.450721:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee061f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135593.450733:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee061f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135593.450863:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1783135593.450956:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:12368:x1869752786049280:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 379us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.450966:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 184 00000100:00100000:2.0:1783135593.484536:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135593.484696:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786049408 00000100:00100000:0.0:1783135593.484707:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786049408 00000100:00100000:0.0:1783135593.484785:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 185 00000100:00100000:0.0:1783135593.484796:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+17:12370:x1869752786049408:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135593.484821:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135593.484842:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0626 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140e9d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.484912:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee062d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.484927:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee062d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.484956:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee062d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.484985:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0634 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.484993:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0634 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485000:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0634 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485579:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485591:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485599:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135593.485646:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783135593.485651:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135593.485672:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485682:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485692:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee062d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485710:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee062d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485899:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee062d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485907:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135593.485911:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee062d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485919:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee062d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485933:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:0.0:1783135593.485936:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135593.485941:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee062d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485946:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee062d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.485964:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0634 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.486188:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0634 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.486195:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0634 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.486201:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135593.486212:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0634 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.486220:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0634 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.486229:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac5424cc200) 00010000:00010000:0.0:1783135593.486232:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135593.486235:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0634 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.486242:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0634 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.486302:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0626 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e9d expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.486319:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e9d expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135593.486327:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:0.0:1783135593.486330:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135593.486333:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989600, rc 0) 00000100:00100000:0.0:1783135593.486434:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:12370:x1869752786049408:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1630us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135593.486444:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 185 00000100:00100000:3.0:1783135593.838300:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809182208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135593.838385:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135593.838493:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809182208 00000100:00100000:3.0:1783135593.838501:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809182208 00000100:00100000:3.0:1783135593.838552:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783135593.838561:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac66b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869752809182208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135593.838592:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135593.838636:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac66b59b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1869752809182208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.838643:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783135593.838696:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809182208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135593.838907:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135593.838919:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809182336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135593.838951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135593.839154:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809182464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135593.839181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135593.839318:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809182976:0@lo:400:kworker.0 00000100:00100000:0.0:1783135593.839347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135593.839371:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809183488:0@lo:400:kworker.0 00000100:00100000:0.0:1783135593.839394:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135593.839414:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783135593.839430:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809182848:0@lo:400:kworker.0 00000100:00100000:0.0:1783135593.839465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135593.839483:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809183360:0@lo:400:kworker.0 00000100:00100000:0.0:1783135593.839505:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135593.839532:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809182976 00000100:00100000:0.0:1783135593.839536:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809182976 00000100:00100000:0.0:1783135593.839567:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809183488 00000100:00100000:0.0:1783135593.839570:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809183488 00000100:00100000:0.0:1783135593.839595:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809183360 00000100:00100000:0.0:1783135593.839597:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809183360 00000100:00100000:0.0:1783135593.839614:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1783135593.839621:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809182976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135593.839665:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809182976:12345-0@lo:400:kworker.0 Request processed in 43us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135593.839670:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1783135593.839686:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1783135593.839692:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809183488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135593.839719:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1869752809183488:12345-0@lo:400:kworker.0 Request processed in 28us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135593.839735:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1783135593.839748:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1783135593.839754:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809183360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135593.839784:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809183360:12345-0@lo:400:kworker.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135593.839790:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1783135593.839808:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809182848 00000100:00100000:0.0:1783135593.839812:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809182848 00000100:00100000:0.0:1783135593.839835:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1783135593.839841:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809182848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135593.839874:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809182848:12345-0@lo:400:kworker.0 Request processed in 32us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135593.839880:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:0.0:1783135593.839899:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135593.839903:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135593.839932:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809182848:0@lo:400:kworker.0 00010000:00080000:0.0:1783135593.839945:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438af480 x1869752809183360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135593.839955:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809183360:0@lo:400:kworker.0 00000100:00100000:0.0:1783135593.839964:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809182976:0@lo:400:kworker.0 00000100:00100000:0.0:1783135593.839972:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1869752809183488:0@lo:400:kworker.0 00000100:00100000:1.0:1783135593.840155:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809182336 00000100:00100000:1.0:1783135593.840161:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809182336 00000100:00100000:1.0:1783135593.840190:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809182464 00000100:00100000:1.0:1783135593.840194:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809182464 00000100:00100000:1.0:1783135593.840211:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783135593.840218:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809182336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135593.840239:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783135593.840273:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809182336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135593.840279:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783135593.840292:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783135593.840297:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809182464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135593.840307:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1783135593.840331:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809182464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135593.840344:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783135593.840448:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809183872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135593.840486:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135593.840535:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809182592:0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.840563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135593.840588:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809183104:0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.840609:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135593.840623:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809183616:0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.840646:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135593.840673:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783135593.840679:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809182720:0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.840702:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135593.840716:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809183232:0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.840735:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135593.840751:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809183744:0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.840773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135593.840797:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809182592 00000100:00100000:3.0:1783135593.840802:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809182592 00000100:00100000:3.0:1783135593.840831:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1783135593.840837:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809182592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.840869:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809182592:12345-0@lo:400:kworker.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.840875:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1783135593.840904:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809183744 00000100:00100000:3.0:1783135593.840907:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809183744 00000100:00100000:3.0:1783135593.840934:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783135593.840940:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809183744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.840968:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809183744:12345-0@lo:400:kworker.0 Request processed in 28us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.840974:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783135593.840992:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809183616 00000100:00100000:3.0:1783135593.840995:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809183616 00000100:00100000:3.0:1783135593.841015:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809182720 00000100:00100000:3.0:1783135593.841017:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809182720 00000100:00100000:3.0:1783135593.841029:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809183232 00000100:00100000:3.0:1783135593.841031:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809183232 00000100:00100000:3.0:1783135593.841042:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1783135593.841055:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809183616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.841082:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809183616:12345-0@lo:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.841119:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1783135593.841131:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1783135593.841137:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809182720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.841162:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809182720:12345-0@lo:400:kworker.0 Request processed in 26us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.841167:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1783135593.841177:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1783135593.841183:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809183232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.841207:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809183232:12345-0@lo:400:kworker.0 Request processed in 25us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.841212:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1783135593.841232:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809183872 00000100:00100000:3.0:1783135593.841235:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809183872 00000100:00100000:3.0:1783135593.841254:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809183104 00000100:00100000:3.0:1783135593.841257:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809183104 00000100:00100000:3.0:1783135593.841267:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1783135593.841272:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809183872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135593.841297:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1783135593.841334:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809183872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.841340:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1783135593.841351:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1783135593.841357:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809183104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.841393:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809183104:12345-0@lo:400:kworker.0 Request processed in 36us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135593.841399:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1783135593.841451:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809183872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135593.841482:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809182720:0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.841491:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809183232:0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.841501:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809183744:0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.841508:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809182592:0@lo:400:kworker.0 00000100:00100000:3.0:1783135593.841517:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6412a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809183104:0@lo:400:kworker.0 00010000:00080000:3.0:1783135593.841528:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543a3f480 x1869752809183616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135593.841537:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809183616:0@lo:400:kworker.0 00000100:00080000:0.0:1783135593.842594:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135593.842604:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135593.842607:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135593.842623:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135593.842645:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809184000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135593.842700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135593.842753:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809182464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135593.842772:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809182336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135593.842922:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809184000 00000100:00100000:2.0:1783135593.842929:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809184000 00000100:00100000:2.0:1783135593.842979:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783135593.842987:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809184000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135593.843006:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135593.843062:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809184000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135593.843068:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783135593.843194:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809184000:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1783135594.031904:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135594.031915:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135594.031944:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1783135594.031952:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135594.032144:0:13815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809184128:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135594.032289:0:13815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66bcea540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135594.040290:0:13815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809184128:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135594.047697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135594.047785:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786049536 00000100:00100000:0.0:1783135594.047806:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786049536 00000100:00100000:0.0:1783135594.047893:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 186 00000100:00100000:0.0:1783135594.047904:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:12381:x1869752786049536:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135594.047942:0:6523:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135594.048069:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:12381:x1869752786049536:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 167us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135594.048078:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 186 00000100:00080000:1.0:1783135594.048603:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135594.051965:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135594.052061:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786049664 00000100:00100000:0.0:1783135594.052072:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786049664 00000100:00100000:0.0:1783135594.052162:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 187 00000100:00100000:0.0:1783135594.052173:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:12381:x1869752786049664:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783135594.052274:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0642 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052414:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0642 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052439:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0642 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052598:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0649 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052625:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0649 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052632:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0649 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052665:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052674:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052681:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135594.052732:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783135594.052737:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135594.052750:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052762:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0642 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052768:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0642 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052776:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0642 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052782:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135594.052786:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0642 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052800:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0642 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052814:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:0.0:1783135594.052817:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135594.052822:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0642 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052828:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0642 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052848:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0649 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052853:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0649 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052859:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0649 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052864:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135594.052866:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0649 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052872:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0649 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052879:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8ac5424cc200) 00010000:00010000:0.0:1783135594.052882:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135594.052884:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0649 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052899:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0649 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052918:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052923:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052929:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052934:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135594.052938:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052944:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052952:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:0.0:1783135594.052954:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135594.052957:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.052963:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0650 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135594.053054:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:12381:x1869752786049664:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 Request processed in 879us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135594.053065:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 187 00000100:00100000:0.0:1783135594.060914:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135594.061001:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786049920 00000100:00100000:1.0:1783135594.061012:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786049920 00000100:00100000:1.0:1783135594.061083:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 188 00000100:00100000:1.0:1783135594.061125:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:12381:x1869752786049920:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135594.061150:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135594.061172:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0657 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ea4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061302:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee065e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061317:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee065e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061329:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee065e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135594.061340:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783135594.061438:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee065e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061447:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee065e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061472:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee065e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061479:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135594.061484:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee065e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061493:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee065e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061505:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135594.061509:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135594.061513:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee065e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061520:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee065e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061565:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0657 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ea4 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061574:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:1.0:1783135594.061576:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135594.061580:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0657 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ea4 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.061589:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9a00, rc 0) 00000100:00100000:1.0:1783135594.061649:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12381:x1869752786049920:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 529us (747us total) trans 4294967460 rc 301/301 00000100:00100000:1.0:1783135594.061664:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 188 00000100:00100000:1.0:1783135594.066012:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.066080:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786050048 00000100:00100000:3.0:1783135594.066372:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786050048 00000100:00100000:3.0:1783135594.066851:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 189 00000100:00100000:3.0:1783135594.066864:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12381:x1869752786050048:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783135594.066903:0:6524:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783135594.067028:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12381:x1869752786050048:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 166us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.067037:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 189 00000100:00100000:2.0:1783135594.070060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.072064:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786050304 00000100:00100000:3.0:1783135594.072116:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786050304 00000100:00100000:3.0:1783135594.072200:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 190 00000100:00100000:3.0:1783135594.072211:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12381:x1869752786050304:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135594.072236:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135594.072240:0:13464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783135594.072268:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee0618 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e96 expref: 19 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.072292:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:3.0:1783135594.072298:0:13464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135594.072313:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee066c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140eab expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135594.073326:0:13464:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1783135594.073850:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628ee0673 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.073867:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628ee0673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.073880:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628ee0673 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.073944:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526400/0xf7de4ef628ee066c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eab expref: 21 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.073966:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628ee0673 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eab expref: 20 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.073995:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c492200) 00010000:00010000:3.0:1783135594.073998:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135594.074002:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526800, rc 0) 00000100:00100000:3.0:1783135594.074114:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12381:x1869752786050304:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1880us (4044us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1783135594.074124:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 190 00000100:00100000:2.0:1783135594.084023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135594.084137:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786050560 00000100:00100000:1.0:1783135594.084150:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786050560 00000100:00100000:1.0:1783135594.084218:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 191 00000100:00100000:1.0:1783135594.084258:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12381:x1869752786050560:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135594.084343:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135594.084376:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628ee0673 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eab expref: 20 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084394:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c492200) 00010000:00010000:1.0:1783135594.084405:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135594.084458:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0681 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084473:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0681 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084485:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0681 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084551:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0688 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8cedf0db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084560:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0688 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cedf0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084567:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0688 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cedf0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084637:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0681 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084646:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0681 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084653:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0681 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084659:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135594.084664:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0681 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084672:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0681 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084681:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135594.084684:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135594.084688:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0681 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084694:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0681 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084704:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0688 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cedf0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084709:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0688 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cedf0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084715:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0688 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cedf0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084725:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135594.084728:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0688 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cedf0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084734:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0688 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8cedf0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084741:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8cedf0db (ffff8ac65800c400) 00010000:00010000:1.0:1783135594.084743:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135594.084746:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0688 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8cedf0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.084752:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0688 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8cedf0db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135594.084847:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12381:x1869752786050560:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 618us (835us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135594.084856:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 191 00000100:00100000:1.0:1783135594.091964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135594.094475:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786050688 00000100:00100000:2.0:1783135594.094492:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786050688 00000100:00100000:2.0:1783135594.094696:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 192 00000100:00100000:2.0:1783135594.094708:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12381:x1869752786050688:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135594.094729:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135594.094756:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee068f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140eb2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.094793:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.094809:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.094822:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.094944:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee068f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb2 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.094962:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb2 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.094971:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:2.0:1783135594.094974:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135594.094978:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909000, rc 0) 00000100:00100000:2.0:1783135594.095044:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12381:x1869752786050688:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 338us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135594.095051:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 192 00000100:00100000:2.0:1783135594.113370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135594.113958:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786050944 00000100:00100000:1.0:1783135594.113969:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786050944 00000100:00100000:1.0:1783135594.114033:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 193 00000100:00100000:1.0:1783135594.114042:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12381:x1869752786050944:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135594.114167:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.114185:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.114216:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135594.114459:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1783135594.114473:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 497907384409ns, next at 498907381209ns, rc = 0 00000004:00010000:1.0:1783135594.114529:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076756e23 reply state 0000000083cfc4f7 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.114543:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.114552:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:1.0:1783135594.114555:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783135594.114560:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135594.114673:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:12381:x1869752786050944:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 630us (1313us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1783135594.114682:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 193 00000100:00100000:2.0:1783135594.119267:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135594.119603:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786051072 00000100:00100000:1.0:1783135594.119615:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786051072 00000100:00100000:1.0:1783135594.119692:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 194 00000100:00100000:1.0:1783135594.119702:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:12381:x1869752786051072:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135594.119734:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135594.119758:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee06a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140eb9 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.119825:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee06a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb9 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.119861:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee06a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb9 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.119885:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:1.0:1783135594.119888:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135594.119892:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9a00, rc 0) 00000100:00100000:1.0:1783135594.119959:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:12381:x1869752786051072:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 258us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135594.119968:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 194 00000100:00100000:2.0:1783135594.130918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.131196:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786051200 00000100:00100000:3.0:1783135594.131209:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786051200 00000100:00100000:3.0:1783135594.131273:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:3.0:1783135594.131285:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+6:2400:x1869752786051200:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783135594.131610:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786051200:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 326us (702us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783135594.131619:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:2.0:1783135594.136122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.137672:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786051456 00000100:00100000:3.0:1783135594.137687:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786051456 00000100:00100000:3.0:1783135594.137755:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:3.0:1783135594.137767:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:12381:x1869752786051456:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783135594.138005:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:12381:x1869752786051456:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 240us (1891us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1783135594.138014:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:0.0:1783135594.146985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.148590:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786051712 00000100:00100000:3.0:1783135594.148608:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786051712 00000100:00100000:3.0:1783135594.148680:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 195 00000100:00100000:3.0:1783135594.148690:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:12381:x1869752786051712:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135594.148817:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:12381:x1869752786051712:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 128us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.148826:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 195 00000100:00100000:2.0:1783135594.154032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135594.156356:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786051840 00000100:00100000:0.0:1783135594.156371:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786051840 00000100:00100000:0.0:1783135594.156452:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 196 00000100:00100000:0.0:1783135594.156464:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:12381:x1869752786051840:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135594.156486:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135594.156518:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee06ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ec0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.156588:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee06b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.156602:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee06b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.156612:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee06b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135594.156657:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135594.156675:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee06b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.156700:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee06ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec0 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.156718:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee06b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec0 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.156727:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:0.0:1783135594.156736:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783135594.156741:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989000, rc 0) 00000100:00100000:0.0:1783135594.156805:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:12381:x1869752786051840:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 343us (2783us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135594.156812:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 196 00000100:00100000:1.0:1783135594.166822:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.166892:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786051968 00000100:00100000:3.0:1783135594.166901:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786051968 00000100:00100000:3.0:1783135594.166963:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:3.0:1783135594.166973:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752786051968:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135594.166992:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135594.167012:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae47004/0xf7de4ef628ee06b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ec7 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135594.167035:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487d6a, blocks: 0x0 00010000:00010000:3.0:1783135594.167055:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1783135594.167059:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135594.167069:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae47004/0xf7de4ef628ee06b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec7 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.167108:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ae47004/0xf7de4ef628ee06b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec7 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.167124:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e000, rc 0) 00000100:00100000:3.0:1783135594.167189:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786051968:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 216us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.167197:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:0.0:1783135594.170777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.170857:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786052224 00000100:00100000:3.0:1783135594.170874:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786052224 00000100:00100000:3.0:1783135594.170943:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 197 00000100:00100000:3.0:1783135594.170954:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:12381:x1869752786052224:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135594.171078:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:12381:x1869752786052224:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 126us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.171112:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 197 00000100:00100000:3.0:1783135594.178726:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135594.178936:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786052352 00000100:00100000:1.0:1783135594.178947:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786052352 00000100:00100000:1.0:1783135594.179015:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:1.0:1783135594.179026:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:12381:x1869752786052352:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135594.179048:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135594.179067:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ece expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.179126:0:8620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ae47004/0xf7de4ef628ee06b9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec7 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.179136:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135594.179140:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135594.179145:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 9 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.179200:0:8620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ae47004/0xf7de4ef628ee06b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec7 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.179214:0:8620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ae47004/0xf7de4ef628ee06b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec7 expref: 9 pid: 8435 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135594.179228:0:8620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8620:1869752809184256:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135594.179325:0:8620:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135594.188911:0:8620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8620:1869752809184256:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135594.188949:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 9 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.188971:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e8e00, rc 0) 00000100:00100000:1.0:1783135594.189033:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6412a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:12381:x1869752786052352:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 10008us (10320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135594.189044:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:0.0:1783135594.189714:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.190408:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786052480 00000100:00100000:3.0:1783135594.190428:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786052480 00010000:00010000:3.0:1783135594.190484:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ae47004/0xf7de4ef628ee06b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec7 expref: 9 pid: 8435 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135594.190528:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:3.0:1783135594.190537:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6618ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2400:x1869752786052480:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135594.190554:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135594.190578:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ae47004/0xf7de4ef628ee06b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec7 expref: 9 pid: 8435 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.190594:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ae47004/0xf7de4ef628ee06b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec7 expref: 9 pid: 8435 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.190637:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae47004/0xf7de4ef628ee06b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec7 expref: 9 pid: 8435 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.190654:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135594.190659:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135594.190684:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 8 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.190695:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 8 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.190743:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 8 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135594.190758:0:6507:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6507:1869752809184384:192.168.204.6@tcp:105: 00000100:00100000:3.0:1783135594.190847:0:6507:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135594.200379:0:6507:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6507:1869752809184384:192.168.204.6@tcp:105: 00010000:00010000:3.0:1783135594.200405:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135594.200480:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6618ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786052480:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 9942us (10769us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.200493:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:0.0:1783135594.206837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135594.206942:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786052608 00000100:00100000:2.0:1783135594.206954:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786052608 00002000:00100000:2.0:1783135594.207013:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ac543b73480 x1869752786052608/t0(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:10/0 lens 504/0 e 0 to 0 dl 1783135605 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135594.207026:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac543b73480 with x1869752786052608 ext(0->8) 00002000:00010000:2.0:1783135594.207032:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac543b73480 00000100:00100000:2.0:1783135594.207064:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:2.0:1783135594.207073:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786052608:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783135594.209047:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2400:x1869752786052608:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 Request processed in 1962us (2210us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783135594.209065:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00002000:00100000:2.0:1783135594.209079:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ac543b73480 x1869752786052608/t4294967315(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:10/0 lens 504/448 e 0 to 0 dl 1783135605 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135594.209747:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac543b73480 with x1869752786052608 ext(0->8) 00002000:00010000:2.0:1783135594.209755:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac543b73480 00000100:00100000:3.0:1783135594.212333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135594.212474:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786052736 00000100:00100000:2.0:1783135594.212485:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786052736 00000100:00100000:2.0:1783135594.212547:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 198 00000100:00100000:2.0:1783135594.212564:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:12381:x1869752786052736:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783135594.214383:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:3.0:1783135594.214421:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1783135594.214461:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1783135594.215279:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135594.215311:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809184512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783135594.215406:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135594.215468:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809184512 00000100:00100000:2.0:1783135594.215476:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809184512 00000100:00100000:2.0:1783135594.215529:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783135594.215538:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809184512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783135594.215669:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783135594.215673:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783135594 00002000:00010000:2.0:1783135594.215675:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783135594.215678:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783135594 -> 1783135594 00002000:00010000:2.0:1783135594.215680:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1783135594.215731:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1869752809184512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (325us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1783135594.215740:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783135594.215857:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12381:x1869752786052736:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 Request processed in 3295us (3536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135594.215867:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 198 00000020:00080000:0.0:1783135594.216389:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1783135594.216402:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1783135594.216581:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.216593:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.216602:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.216609:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135594.216627:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.216636:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.216655:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:1.0:1783135594.216658:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783135594.216663:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.216669:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee069d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783135594.217709:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac543794000/2, rc 0, transno 4294967316 00000100:00100000:2.0:1783135594.217723:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809184512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783135594.219339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135594.219547:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786052864 00000100:00100000:2.0:1783135594.219556:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786052864 00000100:00100000:2.0:1783135594.219646:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:2.0:1783135594.219657:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2400:x1869752786052864:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1783135594.221777:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1783135594.221797:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1783135594.222015:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786052864:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 Request processed in 2353us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135594.222029:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:2.0:1783135594.227072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.230297:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786053120 00000100:00100000:3.0:1783135594.230525:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786053120 00000100:00100000:2.0:1783135594.230673:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 199 00000100:00100000:2.0:1783135594.230684:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12381:x1869752786053120:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135594.230764:0:8461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135594.230792:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee06b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ec0 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.230816:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:2.0:1783135594.230821:0:8461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135594.230850:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.230865:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.230875:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135594.231025:0:8461:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000374b9d31 reply state 000000002644dc76 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.231038:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.231045:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:2.0:1783135594.231048:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135594.231051:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135594.231202:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12381:x1869752786053120:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 519us (4140us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1783135594.231209:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 199 00000100:00100000:3.0:1783135594.234687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135594.234856:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786053248 00000100:00100000:1.0:1783135594.234870:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786053248 00000100:00100000:1.0:1783135594.234943:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:1.0:1783135594.234954:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752786053248:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783135594.235186:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1783135594.235191:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783135594 -> 1783135593 00002000:00010000:1.0:1783135594.235193:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783135591 00002000:00010000:1.0:1783135594.235195:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783135594 -> 1783135593 00002000:00010000:1.0:1783135594.235198:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1783135594.235258:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786053248:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 305us (580us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1783135594.235266:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:3.0:1783135594.242899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135594.243027:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786053504 00000100:00100000:1.0:1783135594.243040:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786053504 00000100:00100000:1.0:1783135594.243148:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 200 00000100:00100000:1.0:1783135594.243159:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:12381:x1869752786053504:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783135594.243250:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.243268:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb2 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.243277:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.243314:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb2 expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.243329:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb2 expref: 20 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135594.243345:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809184640:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135594.243673:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135594.251675:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809184640:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135594.251709:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135594.253122:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135594.253222:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786053632 00000100:00100000:2.0:1783135594.253232:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786053632 00010000:00010000:2.0:1783135594.253278:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb2 expref: 21 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135594.253343:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 90 00000100:00100000:2.0:1783135594.253355:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:2401:x1869752786053632:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135594.253370:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135594.253377:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb2 expref: 21 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.253391:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb2 expref: 21 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.253427:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0696 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb2 expref: 21 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.253444:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:2.0:1783135594.253450:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.253466:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.253474:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.253508:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135594.253567:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:2401:x1869752786053632:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 214us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135594.253575:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 90 00010000:00010000:2.0:1783135594.253952:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.253961:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.254003:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.254010:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.254017:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.254022:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135594.254026:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.254034:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.254043:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:2.0:1783135594.254045:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783135594.254049:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.254064:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135594.254149:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5437a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12381:x1869752786053504:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 Request processed in 10991us (11262us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783135594.254158:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 200 00000100:00100000:3.0:1783135594.261960:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135594.262184:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786053760 00000100:00100000:0.0:1783135594.262195:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786053760 00000100:00100000:0.0:1783135594.262310:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:0.0:1783135594.262321:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786053760:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783135594.262372:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.262393:0:8620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 8 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.262401:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783135594.262406:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135594.262420:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.262468:0:8620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 8 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.262490:0:8620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 8 pid: 8620 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135594.262506:0:8620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8620:1869752809184768:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135594.262609:0:8620:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317df00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135594.272218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135594.272329:0:8620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8620:1869752809184768:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135594.272366:0:8620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135594.272455:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786053888 00000100:00100000:3.0:1783135594.272464:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786053888 00010000:00010000:3.0:1783135594.272508:0:10345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 9 pid: 8620 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135594.272548:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 91 00000100:00100000:3.0:1783135594.272558:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2401:x1869752786053888:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135594.272575:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135594.272601:0:10345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 9 pid: 8620 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.272614:0:10345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 9 pid: 8620 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.272641:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee06c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ece expref: 9 pid: 8620 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.272657:0:10345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135594.272661:0:10345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135594.272667:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.272676:0:10345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.272816:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135594.272874:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786053888:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 316us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.272890:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 91 00010000:00010000:1.0:1783135594.275841:0:8620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.275863:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.275908:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.275918:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.275928:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.275936:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988800 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135594.275940:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.275949:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.275970:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.275980:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee06d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135594.276116:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752786053760:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 Request processed in 13791us (14162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135594.276127:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:1.0:1783135594.287842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135594.287985:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786054144 00000100:00100000:2.0:1783135594.287995:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786054144 00000100:00100000:2.0:1783135594.288054:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 201 00000100:00100000:2.0:1783135594.288063:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12381:x1869752786054144:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783135594.288155:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.288173:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e57 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.288183:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.288213:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e57 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.288225:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e57 expref: 19 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135594.288239:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809184896:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135594.288386:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135594.291572:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809184896:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135594.291607:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135594.301790:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135594.301969:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786054272 00000100:00100000:0.0:1783135594.301980:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786054272 00010000:00010000:0.0:1783135594.302029:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e57 expref: 20 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135594.302069:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 92 00000100:00100000:0.0:1783135594.302078:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:2401:x1869752786054272:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135594.302111:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135594.302118:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e57 expref: 20 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302132:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e57 expref: 20 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302151:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640030e00/0xf7de4ef628ee0523 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e57 expref: 20 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302166:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:0.0:1783135594.302171:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302187:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302194:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302220:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135594.302277:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:2401:x1869752786054272:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 198us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135594.302284:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 92 00010000:00010000:0.0:1783135594.302459:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302467:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302668:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302682:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee06a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb9 expref: 19 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302689:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302726:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee06a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb9 expref: 19 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.302743:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee06a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb9 expref: 19 pid: 8461 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135594.302773:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b70380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809185024:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135594.302845:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317da80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135594.313686:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135594.313721:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b70380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809185024:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135594.313753:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135594.313877:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786054400 00000100:00100000:2.0:1783135594.313885:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786054400 00010000:00010000:2.0:1783135594.313927:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee06a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb9 expref: 20 pid: 8461 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135594.313971:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00100000:2.0:1783135594.313981:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:2401:x1869752786054400:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135594.313997:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135594.314004:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee06a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb9 expref: 20 pid: 8461 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.314016:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee06a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb9 expref: 20 pid: 8461 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.314039:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee06a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eb9 expref: 20 pid: 8461 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.314055:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:2.0:1783135594.314060:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.314070:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.314077:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.314142:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135594.314200:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:2401:x1869752786054400:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 221us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135594.314208:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 93 00010000:00010000:2.0:1783135594.314879:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.314889:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135594.315017:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1783135594.315182:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1783135594.315219:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1783135594.315330:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1869752809185152:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783135594.315387:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135594.315432:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317a840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135594.315455:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809185152 00000100:00100000:2.0:1783135594.315461:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809185152 00000100:00100000:2.0:1783135594.315502:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783135594.315510:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1869752809185152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783135594.315587:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1869752809185152:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135594.315875:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783135594.315922:0:6524:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1783135594.315928:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac543794000, transno 4294967316 00000100:00100000:2.0:1783135594.315984:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1869752809185152:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783135594.316140:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:2.0:1783135594.316190:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1869752809185280:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783135594.316227:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135594.316270:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135594.322777:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809185280 00000100:00100000:1.0:1783135594.322793:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809185280 00000100:00100000:1.0:1783135594.322873:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1783135594.322884:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac672e62c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1869752809185280:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783135594.323137:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac672e62c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1869752809185280:12345-0@lo:1000:mdt00_002.0 Request processed in 253us (6907us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1783135594.323145:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1783135594.323725:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1869752809185280:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1783135594.323786:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323797:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323806:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323813:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135594.323818:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323826:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323861:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:1.0:1783135594.323865:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135594.323870:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323877:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee06e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323903:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee061f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323910:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee061f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323916:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee061f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323921:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135594.323924:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee061f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323930:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee061f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323938:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:1.0:1783135594.323940:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135594.323943:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee061f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323948:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee061f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323980:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.323996:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e9d expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.324005:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.324038:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e9d expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.324054:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e9d expref: 22 pid: 6523 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135594.324069:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f884e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809185408:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135594.324195:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882540 going to sleep for 11 seconds 00000100:00100000:0.0:1783135594.330808:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135594.330839:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786054528 00000100:00100000:0.0:1783135594.330847:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786054528 00010000:00010000:0.0:1783135594.330893:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e9d expref: 23 pid: 6523 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135594.330931:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 94 00000100:00100000:0.0:1783135594.330941:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:2400:x1869752786054528:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135594.330959:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135594.330967:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e9d expref: 23 pid: 6523 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.330982:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e9d expref: 23 pid: 6523 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.331006:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:0.0:1783135594.331012:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.331022:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.331036:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.331057:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135594.331135:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:2400:x1869752786054528:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 194us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135594.331144:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 94 00010000:00010000:2.0:1783135594.331194:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee063b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140e9d expref: 22 pid: 6523 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135594.331219:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f884e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809185408:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135594.331247:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331257:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331264:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331278:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331285:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331306:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331312:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135594.331316:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331324:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331333:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:2.0:1783135594.331336:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135594.331347:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331352:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee06ea lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331363:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331369:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331374:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331378:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135594.331380:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331385:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331392:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800c600) 00010000:00010000:2.0:1783135594.331394:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135594.331396:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.331401:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee06dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135594.331603:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:12381:x1869752786054144:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 43540us (43772us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1783135594.331613:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 201 00000020:00080000:2.0:1783135594.331623:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783135594.331816:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135594.331821:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1783135594.335057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.335226:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786054784 00000100:00100000:3.0:1783135594.335239:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786054784 00000100:00100000:3.0:1783135594.335290:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:3.0:1783135594.335307:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660a8d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:12381:x1869752786054784:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783135594.335761:0:6526:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783135594.335800:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1783135594.335835:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.335855:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.335867:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.335877:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.335883:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.335888:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.335905:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783135594.336005:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660a8d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:12381:x1869752786054784:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 706us (959us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783135594.336014:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 50 00000020:00080000:3.0:1783135594.336027:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783135594.337048:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135594.337062:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.337071:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f600 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135594.337076:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.337084:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.337126:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:2.0:1783135594.337129:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783135594.337133:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.337139:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee06f1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135594.337153:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135594.337155:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135594.337156:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135594.337911:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1783135594.337928:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783135594.350482:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135594.468519:0:14623:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135594.468529:0:14623:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135594.468633:0:14623:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1783135594.468641:0:14623:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135594.618377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135594.618487:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786055040 00000100:00100000:1.0:1783135594.618499:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786055040 00000100:00100000:1.0:1783135594.618584:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 202 00000100:00100000:1.0:1783135594.618596:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:12391:x1869752786055040:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135594.618625:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135594.618649:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee06f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ed5 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.618775:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee06ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.618810:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee06ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.618824:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee06ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135594.618836:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1783135594.618947:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee06f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ed5 expref: 26 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.618966:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee06ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ed5 expref: 25 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.618975:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135594.618978:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135594.618981:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e8a00, rc 0) 00000100:00100000:1.0:1783135594.619045:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:12391:x1869752786055040:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 450us (680us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1783135594.619052:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 202 00000100:00100000:0.0:1783135594.626359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135594.626464:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786055168 00000100:00100000:1.0:1783135594.626477:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786055168 00000100:00100000:1.0:1783135594.626549:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 203 00000100:00100000:1.0:1783135594.626561:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:12391:x1869752786055168:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:1.0:1783135594.626645:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee070d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626664:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee070d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626691:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee070d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626709:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee0714 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626717:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee0714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626724:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee0714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626808:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626816:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626822:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135594.626876:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626891:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee070d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626898:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee070d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626905:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee070d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626921:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135594.626926:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee070d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626934:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee070d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626947:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135594.626951:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135594.626956:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee070d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626962:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee070d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626979:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee0714 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626985:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee0714 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626991:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee0714 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.626996:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135594.626999:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee0714 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.627005:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee0714 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.627024:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac65800c400) 00010000:00010000:1.0:1783135594.627027:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135594.627030:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee0714 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.627036:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee0714 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.627053:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.627059:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.627065:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.627069:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135594.627118:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.627126:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.627133:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:1.0:1783135594.627135:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135594.627138:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.627143:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee071b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135594.627240:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:12391:x1869752786055168:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 680us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135594.627248:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 203 00000100:00100000:3.0:1783135594.701850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.701892:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786055424 00000100:00100000:3.0:1783135594.701901:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786055424 00000100:00100000:3.0:1783135594.701959:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 204 00000100:00100000:3.0:1783135594.701970:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:12394:x1869752786055424:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135594.701992:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135594.702014:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0722 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140edc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.702113:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0729 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.702130:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0729 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.702144:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0729 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.702161:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0730 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.702168:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.702174:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.702314:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.702323:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.702330:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135594.702341:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783135594.703712:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0729 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703726:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0729 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703734:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0729 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703740:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135594.703744:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0729 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703750:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0729 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703763:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:3.0:1783135594.703766:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135594.703769:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0729 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703788:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0729 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703799:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703804:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0730 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703809:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703814:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135594.703816:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703821:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0730 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703827:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c491e00) 00010000:00010000:3.0:1783135594.703829:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135594.703831:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0730 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703837:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0730 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703883:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0722 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140edc expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703895:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140edc expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.703908:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:3.0:1783135594.703911:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135594.703913:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f600, rc 0) 00000100:00100000:3.0:1783135594.704016:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:12394:x1869752786055424:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 2047us (2175us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1783135594.704025:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 204 00000100:00100000:0.0:1783135594.711048:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.711153:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786055552 00000100:00100000:3.0:1783135594.711164:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786055552 00000100:00100000:3.0:1783135594.711232:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 205 00000100:00100000:3.0:1783135594.711242:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:12394:x1869752786055552:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:3.0:1783135594.711426:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0745 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.711514:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.711529:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.711634:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.711642:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0745 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.711649:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.711654:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135594.711675:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.711683:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0745 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.711695:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:3.0:1783135594.711698:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135594.711703:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0745 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.711710:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0745 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135594.711799:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:12394:x1869752786055552:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 557us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.711807:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 205 00000100:00100000:3.0:1783135594.715656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.715697:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786055808 00000100:00100000:3.0:1783135594.715709:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786055808 00000100:00100000:3.0:1783135594.715763:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:3.0:1783135594.715772:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:12394:x1869752786055808:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135594.716018:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+28:12394:x1869752786055808:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 245us (372us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1783135594.716027:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:0.0:1783135594.787215:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.787464:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786056064 00000100:00100000:3.0:1783135594.787474:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786056064 00000100:00100000:3.0:1783135594.787544:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 206 00000100:00100000:3.0:1783135594.787555:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+28:11927:x1869752786056064:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1783135594.787596:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135594.787618:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee074c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ee3 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.787922:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.787939:0:13464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140edc expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.787948:0:13464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.787983:0:13464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140edc expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.787996:0:13464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140edc expref: 29 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135594.788011:0:13464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13464:1869752809185536:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135594.788149:0:13464:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543987cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135594.802009:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.802168:0:13464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13464:1869752809185536:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135594.802201:0:13464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135594.802361:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786056192 00000100:00100000:1.0:1783135594.802370:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786056192 00010000:00010000:1.0:1783135594.802425:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140edc expref: 30 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135594.802463:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 95 00000100:00100000:1.0:1783135594.802473:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:2400:x1869752786056192:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135594.802491:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135594.802498:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140edc expref: 30 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.802512:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140edc expref: 30 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.802535:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f600/0xf7de4ef628ee0737 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140edc expref: 30 pid: 6524 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.802552:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:1.0:1783135594.802556:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.802566:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.802591:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.802622:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135594.802680:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:2400:x1869752786056192:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 207us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135594.802688:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 95 00010000:00010000:3.0:1783135594.802788:0:13464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.802795:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135594.802821:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783135594.802964:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee074c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ee3 expref: 30 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.802979:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ee3 expref: 29 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.802987:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:3.0:1783135594.802989:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135594.802991:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f400, rc 0) 00000100:00100000:3.0:1783135594.803016:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:11927:x1869752786056064:12345-192.168.204.6@tcp:101:bash.0 Request processed in 15463us (15815us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1783135594.803023:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 206 00000100:00100000:1.0:1783135594.809690:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.810393:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786056320 00000100:00100000:3.0:1783135594.810414:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786056320 00000100:00100000:3.0:1783135594.810528:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 207 00000100:00100000:3.0:1783135594.810551:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:11927:x1869752786056320:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1783135594.810577:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135594.810601:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0761 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140eea expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.810636:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0768 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.810653:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.810686:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0768 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.810809:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee0761 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eea expref: 31 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.810829:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0768 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eea expref: 30 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.810839:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:3.0:1783135594.810842:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135594.810845:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e800, rc 0) 00000100:00100000:3.0:1783135594.810920:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:11927:x1869752786056320:12345-192.168.204.6@tcp:101:bash.0 Request processed in 372us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.810927:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 207 00000100:00100000:2.0:1783135594.816558:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.816631:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786056576 00000100:00100000:3.0:1783135594.816642:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786056576 00000100:00100000:3.0:1783135594.816703:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 208 00000100:00100000:3.0:1783135594.816713:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:11927:x1869752786056576:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:3.0:1783135594.816978:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.816997:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.817009:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135594.817069:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:3.0:1783135594.817133:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000081856164 reply state 0000000080a70b7a transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.817146:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.817154:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:3.0:1783135594.817157:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135594.817160:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783135594.817199:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:3.0:1783135594.817298:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+34:11927:x1869752786056576:12345-192.168.204.6@tcp:36:bash.0 Request processed in 585us (763us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1783135594.817306:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 208 00000020:00080000:3.0:1783135594.817311:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1783135594.820748:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.820889:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786056704 00000100:00100000:3.0:1783135594.820900:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786056704 00000100:00100000:3.0:1783135594.820971:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 209 00000100:00100000:3.0:1783135594.820982:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660725050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+34:11927:x1869752786056704:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1783135594.821007:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135594.821027:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628ee0776 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ef1 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.821128:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628ee0776 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef1 expref: 35 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.821145:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628ee0776 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef1 expref: 35 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.821188:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:3.0:1783135594.821191:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135594.821195:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526800, rc 0) 00000100:00100000:3.0:1783135594.821264:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660725050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:11927:x1869752786056704:12345-192.168.204.6@tcp:101:bash.0 Request processed in 283us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.821271:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 209 00000100:00100000:1.0:1783135594.833924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.834084:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786056832 00000100:00100000:3.0:1783135594.834130:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786056832 00000100:00100000:3.0:1783135594.834193:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:3.0:1783135594.834204:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:11927:x1869752786056832:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1783135594.834223:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135594.834244:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee077d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140ef8 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135594.834270:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a487d69, atime: 0x6a487d67, ctime: 0x6a487d69, blocks: 0x8 00010000:00010000:3.0:1783135594.834291:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1783135594.834296:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135594.834304:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee077d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef8 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.834321:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee077d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef8 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.834335:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526400, rc 0) 00000100:00100000:3.0:1783135594.834611:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:11927:x1869752786056832:12345-192.168.204.6@tcp:101:bash.0 Request processed in 407us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.834634:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:2.0:1783135594.847604:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135594.847761:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786056960 00000100:00100000:0.0:1783135594.847772:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786056960 00002000:00010000:0.0:1783135594.847819:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1783135594.847825:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac5441bca80 with x1869752786056960 ext(0->18446744073709551615) 00002000:00010000:0.0:1783135594.847837:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac5441bca80. 00000100:00100000:0.0:1783135594.847874:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:0.0:1783135594.847891:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786056960:12345-192.168.204.6@tcp:10:bash.0 00002000:00010000:0.0:1783135594.848256:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783135594.848261:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1783135593 -> 1783135595 00002000:00010000:0.0:1783135594.848263:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1783135591 -> 1783135591 00002000:00010000:0.0:1783135594.848265:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1783135593 -> 1783135595 00002000:00010000:0.0:1783135594.848278:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1783135594.848337:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2400:x1869752786056960:12345-192.168.204.6@tcp:10:bash.0 Request processed in 453us (743us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1783135594.848345:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00002000:00010000:0.0:1783135594.848348:0:8443:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1783135594.848351:0:8443:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac5441bca80 with x1869752786056960 ext(0->18446744073709551615) 00002000:00010000:0.0:1783135594.848356:0:8443:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac5441bca80. 00000100:00100000:1.0:1783135594.958026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135594.958130:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786057088 00000100:00100000:3.0:1783135594.958141:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786057088 00000100:00100000:3.0:1783135594.958195:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 210 00000100:00100000:3.0:1783135594.958205:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:12408:x1869752786057088:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:3.0:1783135594.958287:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0784 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958306:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0784 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958319:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0784 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958336:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee078b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958343:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee078b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958350:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee078b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958443:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958454:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958461:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135594.958532:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958544:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0784 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958550:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0784 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958557:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0784 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958564:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135594.958569:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0784 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958576:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0784 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958589:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:3.0:1783135594.958592:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135594.958596:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0784 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958602:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0784 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958617:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee078b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958622:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee078b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958633:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee078b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958639:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135594.958642:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee078b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958648:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee078b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958656:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c491700) 00010000:00010000:3.0:1783135594.958658:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135594.958661:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee078b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958667:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee078b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958682:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958687:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958693:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958698:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682173000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135594.958701:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958717:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958725:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:3.0:1783135594.958727:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135594.958731:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135594.958735:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0792 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135594.958825:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:12408:x1869752786057088:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 622us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135594.958834:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 210 00000100:00100000:1.0:1783135595.046924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135595.047077:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786057344 00000100:00100000:2.0:1783135595.047107:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786057344 00000100:00100000:2.0:1783135595.047187:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 211 00000100:00100000:2.0:1783135595.047198:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+35:12411:x1869752786057344:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135595.047222:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135595.047257:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0799 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140eff expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.047435:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee07a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.047453:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee07a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.047468:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee07a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.047484:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee07a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.047492:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee07a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.047498:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee07a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.047625:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee07ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.047636:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee07ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.048541:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee07ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135595.048559:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783135595.051910:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee07a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.051957:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee07a0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.051965:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee07a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.051971:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135595.051976:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee07a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.051986:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee07a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052004:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:2.0:1783135595.052007:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135595.052013:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee07a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052018:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee07a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052037:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee07a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052044:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee07a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052049:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee07a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052054:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135595.052064:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee07a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052072:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee07a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052079:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c7a3d00) 00010000:00010000:2.0:1783135595.052082:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135595.052084:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee07a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052275:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee07a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052354:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0799 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eff expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052371:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee07ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eff expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.052378:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:2.0:1783135595.052380:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783135595.052382:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908400, rc 0) 00000100:00100000:2.0:1783135595.052496:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:12411:x1869752786057344:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 5299us (5585us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1783135595.052507:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 211 00000100:00100000:2.0:1783135595.057637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135595.057925:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786057472 00000100:00100000:0.0:1783135595.057938:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786057472 00000100:00100000:0.0:1783135595.058011:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 212 00000100:00100000:0.0:1783135595.058022:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:12411:x1869752786057472:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:0.0:1783135595.058147:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.058166:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ee3 expref: 37 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.058177:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.058217:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ee3 expref: 37 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.058231:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ee3 expref: 37 pid: 13464 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135595.058246:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809185664:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135595.058357:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135595.066992:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809185664:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135595.067028:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135595.076240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135595.076318:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135595.076360:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135595.076731:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786057728 00000100:00100000:1.0:1783135595.076739:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786057600 00000100:00100000:3.0:1783135595.076742:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786057728 00000100:00100000:1.0:1783135595.076743:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786057600 00002000:00100000:1.0:1783135595.076803:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffff8ac5441bf100 x1869752786057600/t0(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:11/0 lens 496/0 e 0 to 0 dl 1783135606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1783135595.076808:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 67 00002000:00100000:1.0:1783135595.076814:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac5441bf100 with x1869752786057600 ext(0->7) 00000100:00100000:3.0:1783135595.076817:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2401:x1869752786057728:12345-192.168.204.6@tcp:16:kworker.0 00002000:00010000:1.0:1783135595.076819:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac5441bf100 00000100:00100000:1.0:1783135595.076834:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:1.0:1783135595.076840:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2401:x1869752786057600:12345-192.168.204.6@tcp:4:bash.0 00000100:00100000:3.0:1783135595.077047:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786057984 00000100:00100000:3.0:1783135595.077052:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786057984 00000100:00100000:3.0:1783135595.077115:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:3.0:1783135595.077124:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:9943:x1869752786057984:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1783135595.077152:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135595.077639:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+39:9943:x1869752786057984:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 515us (1277us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1783135595.077647:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:0.0:1783135595.087116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135595.087598:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786058112 00000100:00100000:2.0:1783135595.087610:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786058112 00010000:00010000:2.0:1783135595.087665:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ee3 expref: 39 pid: 13464 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135595.087708:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 96 00000100:00100000:2.0:1783135595.087718:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac648bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+39:2400:x1869752786058112:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135595.087735:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135595.087741:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ee3 expref: 39 pid: 13464 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.087754:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ee3 expref: 39 pid: 13464 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.087779:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f400/0xf7de4ef628ee0753 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ee3 expref: 39 pid: 13464 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.087801:0:10344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:2.0:1783135595.087807:0:10344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.087820:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.087829:0:10344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.087871:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135595.087934:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac648bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:2400:x1869752786058112:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 217us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135595.087958:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 96 00010000:00010000:0.0:1783135595.088082:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.088114:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.088160:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.088169:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.088175:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.088181:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135595.088186:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.088195:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.088205:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:0.0:1783135595.088208:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135595.088211:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.088231:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135595.088284:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:12411:x1869752786057472:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 30263us (30657us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135595.088292:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 212 00000001:00080000:2.0:1783135595.089067:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1783135595.089077:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:3.0:1783135595.091836:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2401:x1869752786057728:12345-192.168.204.6@tcp:16:kworker.0 Request processed in 15006us (15598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135595.091867:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:2.0:1783135595.092849:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2401:x1869752786057600:12345-192.168.204.6@tcp:4:bash.0 Request processed in 16002us (16524us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783135595.092862:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00002000:00100000:2.0:1783135595.092877:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffff8ac5441bf100 x1869752786057600/t4294967320(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:11/0 lens 496/448 e 0 to 0 dl 1783135606 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135595.092888:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac5441bf100 with x1869752786057600 ext(0->7) 00002000:00010000:2.0:1783135595.092896:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac5441bf100 00000100:00100000:0.0:1783135595.103923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135595.104069:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786058368 00000100:00100000:1.0:1783135595.104082:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786058368 00000100:00100000:1.0:1783135595.104167:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:1.0:1783135595.104178:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+37:12411:x1869752786058368:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:1.0:1783135595.104419:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:12411:x1869752786058368:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 241us (506us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1783135595.104446:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:3.0:1783135595.284942:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135595.285071:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786058624 00000100:00100000:0.0:1783135595.285084:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786058624 00000100:00100000:0.0:1783135595.285203:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 213 00000100:00100000:0.0:1783135595.285215:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+38:12422:x1869752786058624:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:0.0:1783135595.285247:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135595.285272:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f06 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285359:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee07ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285376:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee07ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285391:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee07ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285418:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee07d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285425:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee07d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285450:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee07d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285590:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee07d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285600:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee07d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285608:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee07d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135595.285618:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1783135595.285708:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee07ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285717:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee07ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285723:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee07ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285729:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135595.285734:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee07ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285741:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee07ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285754:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:0.0:1783135595.285758:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135595.285770:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee07ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285777:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee07ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285798:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee07d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285803:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee07d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285809:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee07d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285814:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135595.285817:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee07d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285822:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee07d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285830:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac5424cc200) 00010000:00010000:0.0:1783135595.285832:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135595.285835:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee07d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285840:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee07d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285883:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee07c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f06 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285911:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee07d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f06 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.285918:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:0.0:1783135595.285920:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135595.285923:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988400, rc 0) 00000100:00100000:0.0:1783135595.285994:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+40:12422:x1869752786058624:12345-192.168.204.6@tcp:101:cat.0 Request processed in 782us (1066us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1783135595.286002:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 213 00000100:00100000:0.0:1783135595.299206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135595.299926:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786058880 00000100:00100000:1.0:1783135595.299937:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786058880 00000100:00100000:1.0:1783135595.300175:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:1.0:1783135595.300190:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+40:12422:x1869752786058880:12345-192.168.204.6@tcp:35:cat.0 00000100:00100000:1.0:1783135595.300577:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+41:12422:x1869752786058880:12345-192.168.204.6@tcp:35:cat.0 Request processed in 389us (1380us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1783135595.300586:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:2.0:1783135595.357865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135595.358003:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786059136 00000100:00100000:3.0:1783135595.358014:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786059136 00000100:00100000:3.0:1783135595.358128:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 214 00000100:00100000:3.0:1783135595.358139:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+41:12423:x1869752786059136:12345-192.168.204.6@tcp:36:rm.0 00010000:00010000:3.0:1783135595.358204:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1783135595.358232:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526800/0xf7de4ef628ee0776 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef1 expref: 41 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358256:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee07d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f06 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358272:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee07ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eff expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358285:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e800/0xf7de4ef628ee0768 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140eea expref: 38 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358296:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:3.0:1783135595.358300:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135595.358322:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee07e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358335:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee07e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358345:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee07e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358375:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358383:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358401:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358483:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee07f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358492:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee07f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358500:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee07f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135595.358742:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1783135595.358751:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 499151663124ns, next at 500151660630ns, rc = 0 00010000:00010000:3.0:1783135595.358797:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358807:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358815:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358822:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358841:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358847:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358863:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135595.358881:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee07f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358887:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee07f4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358894:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee07f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358900:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135595.358905:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee07f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358913:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee07f4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358922:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:3.0:1783135595.358925:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783135595.358929:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee07f4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358934:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee07f4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358949:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee07e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358961:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee07e6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358975:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee07e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358981:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682173000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135595.358984:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee07e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.358991:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee07e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.359000:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:3.0:1783135595.359003:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135595.359006:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee07e6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.359011:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee07e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135595.359022:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000224bd129 reply state 000000001abaa872 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.359033:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.359039:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c491400) 00010000:00010000:3.0:1783135595.359041:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783135595.359044:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135595.359171:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+39:12423:x1869752786059136:12345-192.168.204.6@tcp:36:rm.0 Request processed in 1032us (1319us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1783135595.359186:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 214 00010000:00010000:0.0:1783135595.359401:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135595.359408:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.359415:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172600 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135595.359418:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.359425:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.359434:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:0.0:1783135595.359437:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783135595.359440:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.359447:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172600/0xf7de4ef628ee07fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.359471:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135595.359473:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135595.359475:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135595.374417:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135595.442451:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135595.442589:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786059392 00000100:00100000:0.0:1783135595.442604:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786059392 00000100:00100000:0.0:1783135595.442676:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 215 00000100:00100000:0.0:1783135595.442687:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+39:12429:x1869752786059392:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1783135595.442712:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135595.442732:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee0802 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f0d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.442848:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0809 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.442864:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0809 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.442878:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0809 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.442888:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.442896:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.442902:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135595.443357:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1783135595.443670:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443681:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443689:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443723:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0809 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443730:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0809 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443737:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0809 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443743:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135595.443747:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0809 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443755:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0809 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443768:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:0.0:1783135595.443772:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135595.443776:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0809 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443782:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee0809 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135595.443815:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed9f8456 reply state 00000000706eb8fc transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443828:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443835:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c491400) 00010000:00010000:0.0:1783135595.443838:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135595.443841:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783135595.443872:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee0802 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f0d expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443891:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f0d expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.443899:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac5424cc200) 00010000:00010000:0.0:1783135595.443901:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135595.443903:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989000, rc 0) 00000100:00100000:0.0:1783135595.444035:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+42:12429:x1869752786059392:12345-192.168.204.6@tcp:101:bash.0 Request processed in 1349us (1593us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1783135595.444044:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 215 00000100:00100000:0.0:1783135595.447893:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135595.448012:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786059520 00000100:00100000:2.0:1783135595.448025:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786059520 00000100:00100000:2.0:1783135595.448162:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:2.0:1783135595.448174:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786059520:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1783135595.448195:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135595.448218:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ccf1294/0xf7de4ef628ee0825 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f14 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135595.448244:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135595.448266:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=499s v=(0 0) 00010000:00010000:2.0:1783135595.448270:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135595.448280:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ccf1294/0xf7de4ef628ee0825 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f14 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.448607:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ccf1294/0xf7de4ef628ee0825 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f14 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.448622:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908a00, rc 0) 00000100:00100000:2.0:1783135595.448694:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786059520:12345-192.168.204.6@tcp:101:bash.0 Request processed in 522us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135595.448703:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:2.0:1783135595.451919:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135595.452029:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786059648 00000100:00100000:1.0:1783135595.452039:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786059648 00000100:00100000:1.0:1783135595.452143:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:1.0:1783135595.452153:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:12429:x1869752786059648:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135595.452174:0:8620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135595.452193:0:8620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f1b expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.452226:0:8620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ccf1294/0xf7de4ef628ee0825 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f14 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.452236:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135595.452240:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135595.452245:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 9 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.452279:0:8620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ccf1294/0xf7de4ef628ee0825 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f14 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.452322:0:8620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ccf1294/0xf7de4ef628ee0825 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f14 expref: 9 pid: 8435 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135595.452337:0:8620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f884a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8620:1869752809185792:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135595.452458:0:8620:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5438829c0 going to sleep for 11 seconds 00000100:00080000:0.0:1783135595.455590:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135595.458454:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135595.458776:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786059776 00000100:00100000:0.0:1783135595.458787:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786059776 00010000:00010000:0.0:1783135595.458837:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ccf1294/0xf7de4ef628ee0825 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f14 expref: 10 pid: 8435 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135595.458909:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:0.0:1783135595.458919:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2401:x1869752786059776:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135595.458938:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135595.458965:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ccf1294/0xf7de4ef628ee0825 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f14 expref: 10 pid: 8435 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.458981:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ccf1294/0xf7de4ef628ee0825 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f14 expref: 10 pid: 8435 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.459012:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135595.459017:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135595.459027:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 10 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.459038:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 10 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.459078:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 10 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135595.459136:0:6509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6509:1869752809185920:192.168.204.6@tcp:105: 00000100:00100000:0.0:1783135595.459222:0:6509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d000 going to sleep for 11 seconds 00010000:00010000:1.0:1783135595.459321:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ccf1294/0xf7de4ef628ee0825 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f14 expref: 10 pid: 8435 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135595.459338:0:8620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f884a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8620:1869752809185792:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135595.459364:0:8620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 9 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.459386:0:8620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e8c00, rc 0) 00000100:00100000:1.0:1783135595.459436:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:12429:x1869752786059648:12345-192.168.204.6@tcp:101:bash.0 Request processed in 7285us (7528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135595.459445:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:0.0:1783135595.467505:0:6509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6509:1869752809185920:192.168.204.6@tcp:105: 00010000:00010000:0.0:1783135595.467552:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135595.467618:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786059776:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 8698us (9175us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135595.467630:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:2.0:1783135595.471599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135595.471688:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786060032 00000100:00100000:3.0:1783135595.471700:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786060032 00000100:00100000:3.0:1783135595.471779:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1783135595.471791:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+42:12429:x1869752786060032:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:3.0:1783135595.472166:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:12429:x1869752786060032:12345-192.168.204.6@tcp:35:bash.0 Request processed in 376us (574us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1783135595.472175:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1783135595.699898:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135595.700071:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786060160 00000100:00100000:0.0:1783135595.700083:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786060160 00000100:00100000:0.0:1783135595.700187:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 216 00000100:00100000:0.0:1783135595.700198:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+43:12445:x1869752786060160:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135595.700222:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135595.700241:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee0833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f22 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.700323:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee083a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.700339:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee083a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.700352:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee083a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135595.700411:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1783135595.700415:0:13464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135595.700436:0:13464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee083a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.700462:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee0833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f22 expref: 45 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.700485:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee083a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f22 expref: 44 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.700511:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:0.0:1783135595.700513:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135595.700517:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989800, rc 0) 00000100:00100000:0.0:1783135595.700596:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+44:12445:x1869752786060160:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 399us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135595.700603:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 216 00000100:00100000:2.0:1783135595.713498:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135595.713701:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786060416 00000100:00100000:1.0:1783135595.713715:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786060416 00000100:00100000:1.0:1783135595.713791:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 217 00000100:00100000:1.0:1783135595.713804:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+44:12445:x1869752786060416:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135595.713829:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135595.713863:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0841 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f29 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.714014:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee0848 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.714030:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee0848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.714042:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee0848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135595.714055:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783135595.714210:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0841 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f29 expref: 47 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.714242:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee0848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f29 expref: 46 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.714663:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac5424cc200) 00010000:00010000:1.0:1783135595.714677:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135595.714681:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9800, rc 0) 00000100:00100000:1.0:1783135595.714795:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+46:12445:x1869752786060416:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 975us (1290us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1783135595.714805:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 217 00000100:00100000:2.0:1783135595.720038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135595.720156:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786060672 00000100:00100000:0.0:1783135595.720166:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786060672 00000100:00100000:0.0:1783135595.720240:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 218 00000100:00100000:0.0:1783135595.720250:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+46:12445:x1869752786060672:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135595.720275:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135595.720305:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee0856 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f30 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.720690:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee085d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.720707:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee085d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.720721:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee085d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135595.720734:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783135595.720925:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee0856 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f30 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.720968:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee085d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f30 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.720978:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac5424cc200) 00010000:00010000:0.0:1783135595.720981:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783135595.720985:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988000, rc 0) 00000100:00100000:0.0:1783135595.721052:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+48:12445:x1869752786060672:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 803us (1024us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1783135595.721060:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 218 00000100:00100000:3.0:1783135595.728190:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135595.728820:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786060800 00000100:00100000:1.0:1783135595.728836:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786060800 00000100:00100000:1.0:1783135595.728922:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:1.0:1783135595.728932:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+48:2401:x1869752786060800:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135595.728949:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135595.728989:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee0848 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f29 expref: 48 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.729011:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac5424cc200) 00010000:00010000:1.0:1783135595.729016:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135595.730280:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+47:2401:x1869752786060800:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 1335us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135595.730294:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:2.0:1783135595.736480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135595.736616:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786060928 00000100:00100000:1.0:1783135595.736627:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786060928 00000100:00100000:1.0:1783135595.736692:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:1.0:1783135595.736703:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786060928:12345-192.168.204.6@tcp:1:lfs.0 00010000:00010000:1.0:1783135595.736766:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.736785:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 8 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.736793:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135595.736797:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135595.736801:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.736839:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 8 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.736852:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 8 pid: 8620 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135595.736883:0:8438:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f884a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1869752809186048:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135595.736981:0:8438:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135595.739968:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135595.740646:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786061056 00000100:00100000:0.0:1783135595.740657:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786061056 00002000:00100000:0.0:1783135595.740704:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ac67e2a1180 x1869752786061056/t0(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:11/0 lens 504/0 e 0 to 0 dl 1783135606 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135595.740715:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac67e2a1180 with x1869752786061056 ext(0->8) 00010000:00010000:0.0:1783135595.740725:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 9 pid: 8620 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.740741:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 9 pid: 8620 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135595.740760:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ac67e2a1180 00000100:00100000:0.0:1783135595.740792:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:0.0:1783135595.740803:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2400:x1869752786061056:12345-192.168.204.6@tcp:4:lfs.0 00000100:00100000:0.0:1783135595.742129:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:2400:x1869752786061056:12345-192.168.204.6@tcp:4:lfs.0 Request processed in 1317us (2161us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783135595.742153:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00002000:00100000:0.0:1783135595.742165:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ac67e2a1180 x1869752786061056/t4294967309(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:11/0 lens 504/448 e 0 to 0 dl 1783135606 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135595.742174:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac67e2a1180 with x1869752786061056 ext(0->8) 00010000:00010000:0.0:1783135595.742183:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 11 pid: 8620 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.742198:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 11 pid: 8620 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135595.742218:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ac67e2a1180 00000100:00100000:1.0:1783135595.743015:0:8438:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f884a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1869752809186048:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135595.743051:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135595.747081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135595.748042:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786061184 00000100:00100000:2.0:1783135595.748055:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786061184 00010000:00010000:2.0:1783135595.748270:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 11 pid: 8620 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135595.748503:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:2.0:1783135595.748514:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:2400:x1869752786061184:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135595.748531:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783135595.748550:0:10344:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783135595.748553:0:10344:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1783135596 00002000:00010000:2.0:1783135595.748556:0:10344:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1783135596 00002000:00010000:2.0:1783135595.748558:0:10344:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1783135596 00002000:00010000:2.0:1783135595.748560:0:10344:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1783135595.748580:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 11 pid: 8620 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.748594:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 11 pid: 8620 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.748629:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000280b686c/0xf7de4ef628ee082c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f1b expref: 11 pid: 8620 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.748650:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135595.748655:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135595.748661:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.748670:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.748714:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135595.748855:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2400:x1869752786061184:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 343us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135595.748864:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 98 00010000:00010000:3.0:1783135595.749520:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.749532:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.749554:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.749563:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.749571:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.749593:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9c00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135595.749598:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.749608:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.749624:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.749632:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee086b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135595.749718:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2400:x1869752786060928:12345-192.168.204.6@tcp:1:lfs.0 Request processed in 13016us (13246us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135595.749728:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:3.0:1783135595.754781:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135595.755007:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786061440 00000100:00100000:0.0:1783135595.755017:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786061440 00000100:00100000:0.0:1783135595.755073:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:0.0:1783135595.755082:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+47:12445:x1869752786061440:12345-192.168.204.6@tcp:35:lfs.0 00000004:00010000:0.0:1783135595.755178:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee085d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f30 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135595.755515:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1783135595.755548:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1783135595.755946:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:0.0:1783135595.755980:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.755994:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f0d expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.756022:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.756052:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f0d expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.756065:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f0d expref: 51 pid: 6522 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135595.756079:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b73b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1869752809186176:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135595.756194:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135595.763476:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135595.763588:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786061568 00000100:00100000:2.0:1783135595.763599:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786061568 00010000:00010000:2.0:1783135595.763650:0:10345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f0d expref: 52 pid: 6522 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135595.763687:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 99 00000100:00100000:2.0:1783135595.763696:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:2400:x1869752786061568:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135595.763724:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135595.763730:0:10345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f0d expref: 52 pid: 6522 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.763752:0:10345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f0d expref: 52 pid: 6522 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.763775:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac5424cc200) 00010000:00010000:2.0:1783135595.763780:0:10345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.763790:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.763797:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.763814:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135595.763861:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+52:2400:x1869752786061568:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 166us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135595.763868:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 99 00010000:00010000:3.0:1783135595.765585:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0817 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f0d expref: 51 pid: 6522 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135595.765861:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b73b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1869752809186176:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135595.765892:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.766077:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135595.766400:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135595.766629:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:2.0:1783135595.766841:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1783135595.766955:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869752809186304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783135595.767575:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135595.767651:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135595.767697:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809186304 00000100:00100000:3.0:1783135595.767715:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809186304 00000100:00100000:3.0:1783135595.767904:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783135595.767914:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6526:x1869752809186304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783135595.768019:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6526:x1869752809186304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 106us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135595.768027:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1783135595.768158:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869752809186304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783135595.768329:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1783135595.768407:0:6526:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f884a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869752809186432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783135595.768452:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135595.768475:0:6526:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135595.768732:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809186432 00000100:00100000:2.0:1783135595.768738:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809186432 00000100:00100000:2.0:1783135595.768782:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1783135595.768791:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6526:x1869752809186432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783135595.768919:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6526:x1869752809186432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (466us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783135595.768927:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1783135595.769171:0:6526:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f884a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1869752809186432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783135595.769227:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1783135595.769266:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.769286:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.769294:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.769301:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135595.769306:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.769333:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.769350:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac5424cc200) 00010000:00010000:1.0:1783135595.769353:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783135595.769357:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.769363:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0872 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783135595.769681:0:6526:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783135595.769758:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1783135595.769771:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 499562682651ns, next at 500562679996ns, rc = 0 00000001:00080000:1.0:1783135595.769778:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1783135595.769804:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac5424cc200) 00010000:00010000:1.0:1783135595.769807:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783135595.769814:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee085d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f30 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135595.769913:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:12445:x1869752786061440:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 14831us (15140us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1783135595.769922:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00000020:00080000:1.0:1783135595.769926:0:6526:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783135595.774567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135595.774776:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786061696 00000100:00100000:1.0:1783135595.774788:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786061696 00000100:00100000:1.0:1783135595.774861:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 219 00000100:00100000:1.0:1783135595.774872:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+54:12445:x1869752786061696:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135595.774930:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135595.774963:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee0879 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f37 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.775044:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee0879 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f37 expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.775064:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee0879 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f37 expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.775084:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:1.0:1783135595.775111:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135595.775115:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9800, rc 0) 00000100:00100000:1.0:1783135595.775199:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+55:12445:x1869752786061696:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 328us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135595.775214:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 219 00000100:00100000:3.0:1783135595.780478:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135595.780914:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786061952 00000100:00100000:1.0:1783135595.780928:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786061952 00000100:00100000:1.0:1783135595.780997:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:1.0:1783135595.781008:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+55:12445:x1869752786061952:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:1.0:1783135595.781353:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+56:12445:x1869752786061952:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 345us (884us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1783135595.781361:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00080000:0.0:1783135595.781946:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135595.907246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135595.907415:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786062080 00000100:00100000:1.0:1783135595.907429:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786062080 00000100:00100000:1.0:1783135595.907498:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 220 00000100:00100000:1.0:1783135595.907508:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+56:12455:x1869752786062080:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:1.0:1783135595.907610:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0880 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907628:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0880 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907640:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0880 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907651:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0887 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907658:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0887 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907665:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0887 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907874:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907885:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907894:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135595.907950:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907963:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0880 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907979:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0880 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907985:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0880 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.907990:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135595.907995:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0880 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908001:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0880 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908014:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135595.908017:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135595.908022:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0880 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908028:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0880 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908041:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0887 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908046:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0887 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908051:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0887 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908056:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135595.908063:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0887 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908069:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0887 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908076:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c491400) 00010000:00010000:1.0:1783135595.908079:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135595.908081:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0887 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908139:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee0887 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908150:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908155:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908160:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908165:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135595.908168:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908173:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908179:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:1.0:1783135595.908181:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135595.908189:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135595.908195:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee088e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135595.908832:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+56:12455:x1869752786062080:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 1323us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135595.908843:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 220 00000100:00100000:3.0:1783135595.969307:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135595.969889:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786062336 00000100:00100000:0.0:1783135595.969903:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786062336 00000100:00100000:0.0:1783135595.969985:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 221 00000100:00100000:0.0:1783135595.969996:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+56:12458:x1869752786062336:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135595.970019:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135595.970045:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee0895 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f3e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970152:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee089c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970168:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee089c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970198:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee089c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970212:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970220:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970227:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970357:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee08aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970366:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee08aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970374:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee08aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135595.970395:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783135595.970629:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee089c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970637:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee089c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970643:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee089c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970650:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135595.970662:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee089c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970670:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee089c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970684:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:0.0:1783135595.970688:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135595.970692:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee089c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970774:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee089c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970791:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970797:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970803:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970809:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135595.970813:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970819:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970827:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c491400) 00010000:00010000:0.0:1783135595.970830:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135595.970841:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970847:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970888:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988800/0xf7de4ef628ee0895 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f3e expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970904:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee08aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f3e expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135595.970911:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:0.0:1783135595.970914:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135595.970916:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989000, rc 0) 00000100:00100000:0.0:1783135595.970989:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+58:12458:x1869752786062336:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 994us (1692us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1783135595.970997:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 221 00000100:00100000:0.0:1783135595.975954:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135595.976044:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786062464 00000100:00100000:3.0:1783135595.976056:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786062464 00000100:00100000:3.0:1783135595.976221:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 222 00000100:00100000:3.0:1783135595.976232:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+58:12458:x1869752786062464:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:3.0:1783135595.976320:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee08b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.976338:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee08b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.976350:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee08b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.976399:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee08b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.976406:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee08b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.976413:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee08b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.976441:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682173000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135595.976446:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee08b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.976454:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee08b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.976468:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:3.0:1783135595.976471:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135595.976476:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee08b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135595.976484:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee08b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135595.976718:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+58:12458:x1869752786062464:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 488us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135595.976727:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 222 00000100:00100000:2.0:1783135595.981585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135595.981725:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786062720 00000100:00100000:3.0:1783135595.981735:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786062720 00000100:00100000:3.0:1783135595.981795:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:3.0:1783135595.981806:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+58:12458:x1869752786062720:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135595.982049:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:12458:x1869752786062720:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 244us (476us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1783135595.982058:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:2.0:1783135596.129288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.132659:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786062976 00000100:00100000:1.0:1783135596.132678:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786062976 00000100:00100000:1.0:1783135596.132817:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 223 00000100:00100000:1.0:1783135596.132834:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+59:12468:x1869752786062976:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135596.132862:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135596.132865:0:8461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783135596.132893:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989800/0xf7de4ef628ee083a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f22 expref: 59 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.132923:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135596.132929:0:8461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135596.132946:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee08bf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f45 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.133069:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee08c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.133084:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee08c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.133142:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee08c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135596.133180:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783135596.133303:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee08bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f45 expref: 61 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.133320:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee08c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f45 expref: 60 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.133327:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:1.0:1783135596.133330:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135596.133333:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9a00, rc 0) 00000100:00100000:1.0:1783135596.133870:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+60:12468:x1869752786062976:12345-192.168.204.6@tcp:101:bash.0 Request processed in 582us (4135us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1783135596.133882:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 223 00000100:00080000:0.0:1783135596.134842:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135596.142963:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.143062:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.143257:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786063232 00000100:00100000:1.0:1783135596.143278:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786063232 00000100:00100000:1.0:1783135596.143350:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 224 00000100:00100000:1.0:1783135596.143363:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+60:12468:x1869752786063232:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1783135596.143401:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135596.143441:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee08d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f4c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.143485:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.143501:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.143534:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.143914:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee08d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f4c expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.143935:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f4c expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.143943:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:1.0:1783135596.143946:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135596.143949:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e8c00, rc 0) 00000100:00100000:1.0:1783135596.144021:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:12468:x1869752786063232:12345-192.168.204.6@tcp:101:bash.0 Request processed in 660us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.144029:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 224 00000100:00100000:3.0:1783135596.148210:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786063104 00000100:00100000:3.0:1783135596.148229:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786063104 00000100:00100000:2.0:1783135596.148632:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:2.0:1783135596.148645:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+61:2400:x1869752786063104:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135596.148665:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135596.148694:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee08c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f45 expref: 61 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.148716:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135596.148722:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135596.148808:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+60:2400:x1869752786063104:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 165us (5855us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.148817:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:1.0:1783135596.149081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.150140:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786063488 00000100:00100000:0.0:1783135596.150150:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786063488 00000100:00100000:0.0:1783135596.150202:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 225 00000100:00100000:0.0:1783135596.150211:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+60:12468:x1869752786063488:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:0.0:1783135596.150280:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135596.150303:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee08aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f3e expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.150343:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:0.0:1783135596.150348:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135596.150535:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.150549:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.150558:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135596.150605:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1783135596.150629:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009717178e reply state 000000009ab8a72b transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.150644:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.150650:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:0.0:1783135596.150653:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783135596.150656:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135596.150759:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:12468:x1869752786063488:12345-192.168.204.6@tcp:36:bash.0 Request processed in 548us (1680us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1783135596.150767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 225 00000020:00080000:0.0:1783135596.150772:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783135596.155332:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.155564:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786063616 00000100:00100000:2.0:1783135596.155576:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786063616 00000100:00100000:2.0:1783135596.155652:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 226 00000100:00100000:2.0:1783135596.155665:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+62:12468:x1869752786063616:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1783135596.155718:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.155758:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee08e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f53 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.155855:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.155870:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.155883:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135596.155916:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783135596.155920:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135596.155938:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.155964:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee08e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f53 expref: 64 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.155982:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f53 expref: 63 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.155990:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135596.155993:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135596.155996:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908e00, rc 0) 00000100:00100000:2.0:1783135596.156059:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+63:12468:x1869752786063616:12345-192.168.204.6@tcp:101:bash.0 Request processed in 397us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.156067:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 226 00000100:00100000:1.0:1783135596.161346:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135596.161446:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786063872 00000100:00100000:3.0:1783135596.161469:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786063872 00000100:00100000:3.0:1783135596.161522:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:3.0:1783135596.161531:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+63:12468:x1869752786063872:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:3.0:1783135596.161794:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+64:12468:x1869752786063872:12345-192.168.204.6@tcp:35:bash.0 Request processed in 263us (455us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1783135596.161802:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:0.0:1783135596.245031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.245634:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786064000 00000100:00100000:1.0:1783135596.245647:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786064000 00000100:00100000:1.0:1783135596.245728:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 227 00000100:00100000:1.0:1783135596.246937:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+64:12474:x1869752786064000:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135596.247043:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135596.247070:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee08f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f5a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.247163:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee08fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.247195:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee08fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.247210:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee08fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135596.247260:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1783135596.247263:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135596.247283:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee08fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.247313:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee08f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f5a expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.247334:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee08fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f5a expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.247344:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:1.0:1783135596.247347:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135596.247350:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9e00, rc 0) 00000100:00100000:1.0:1783135596.247810:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+65:12474:x1869752786064000:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 2070us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.247820:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 227 00000100:00100000:1.0:1783135596.253477:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.253897:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786064128 00000100:00100000:2.0:1783135596.253908:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786064128 00000100:00100000:2.0:1783135596.253986:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 228 00000100:00100000:2.0:1783135596.253995:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+65:12474:x1869752786064128:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135596.254017:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.254039:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee0905 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f61 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254145:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee090c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254161:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee090c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254173:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee090c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254184:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0913 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254191:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0913 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254198:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0913 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254279:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee091a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254288:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee091a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254318:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee091a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135596.254586:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783135596.254591:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135596.254615:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee091a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254628:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee091a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254636:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee090c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254643:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee090c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254650:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee090c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254656:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.254660:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee090c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254781:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee090c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.254795:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:2.0:1783135596.254799:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.254803:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee090c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255024:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee090c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255045:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0913 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255051:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0913 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255056:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0913 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255061:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.255064:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0913 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255071:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0913 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255079:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c491400) 00010000:00010000:2.0:1783135596.255082:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.255085:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0913 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255141:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0913 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255174:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908000/0xf7de4ef628ee0905 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f61 expref: 67 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255187:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee091a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f61 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.255202:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135596.255204:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135596.255207:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909e00, rc 0) 00000100:00100000:2.0:1783135596.255282:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:12474:x1869752786064128:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1287us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.255291:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 228 00000100:00100000:2.0:1783135596.261603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.262243:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786064256 00000100:00100000:1.0:1783135596.262255:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786064256 00000100:00100000:1.0:1783135596.262370:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:1.0:1783135596.262391:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:2400:x1869752786064256:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135596.262428:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135596.262461:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee091a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f61 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.262503:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:1.0:1783135596.262517:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135596.262596:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+65:2400:x1869752786064256:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 207us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.262604:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:3.0:1783135596.272298:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.274290:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786064512 00000100:00100000:0.0:1783135596.274307:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786064512 00000100:00100000:0.0:1783135596.274408:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 229 00000100:00100000:0.0:1783135596.274419:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+65:12474:x1869752786064512:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135596.274454:0:13464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135596.274479:0:13464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0921 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f68 expref: -99 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.274610:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.274627:0:13464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f53 expref: 66 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.274636:0:13464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.274950:0:13464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f53 expref: 66 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.274975:0:13464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f53 expref: 66 pid: 8461 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135596.274993:0:13464:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b71180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13464:1869752809186560:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135596.275165:0:13464:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317da80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135596.283148:0:13464:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b71180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13464:1869752809186560:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135596.283183:0:13464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135596.286337:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.286903:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786064640 00000100:00100000:2.0:1783135596.286915:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786064640 00010000:00010000:2.0:1783135596.286965:0:10345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f53 expref: 67 pid: 8461 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.287048:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 100 00000100:00100000:2.0:1783135596.287058:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac648bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+67:2401:x1869752786064640:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135596.287072:0:10345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135596.287079:0:10345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f53 expref: 67 pid: 8461 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.287114:0:10345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f53 expref: 67 pid: 8461 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.287137:0:10345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908e00/0xf7de4ef628ee08f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f53 expref: 67 pid: 8461 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.287155:0:10345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135596.287173:0:10345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.287182:0:10345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.287189:0:10345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.287223:0:10345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135596.287296:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac648bc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:2401:x1869752786064640:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 239us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.287304:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 100 00010000:00010000:3.0:1783135596.287417:0:13464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.287426:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135596.287454:0:13464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783135596.287632:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0921 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f68 expref: 67 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.287654:0:13464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f68 expref: 66 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.287661:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:3.0:1783135596.287664:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135596.287667:0:13464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988000, rc 0) 00000100:00100000:3.0:1783135596.287695:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:12474:x1869752786064512:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 13278us (15407us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1783135596.287703:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 229 00000100:00100000:3.0:1783135596.293572:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.293832:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786064896 00000100:00100000:0.0:1783135596.293842:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786064896 00000100:00100000:0.0:1783135596.293946:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:0.0:1783135596.293968:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:12474:x1869752786064896:12345-192.168.204.6@tcp:103:lfs.0 00010000:00010000:0.0:1783135596.293987:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135596.294014:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee0879 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f37 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.294046:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:0.0:1783135596.294052:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135596.295386:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+65:12474:x1869752786064896:12345-192.168.204.6@tcp:103:lfs.0 Request processed in 1405us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135596.295398:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:1.0:1783135596.298804:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.298957:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786065024 00000100:00100000:0.0:1783135596.298969:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786065024 00000100:00100000:0.0:1783135596.299037:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 230 00000100:00100000:0.0:1783135596.299047:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+65:12474:x1869752786065024:12345-192.168.204.6@tcp:58:lfs.0 00010000:00010000:0.0:1783135596.299189:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.299206:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.299219:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135596.299341:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1783135596.299441:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+65:12474:x1869752786065024:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 394us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135596.299449:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 230 00000100:00100000:3.0:1783135596.308706:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.310028:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786065152 00000100:00100000:1.0:1783135596.310041:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786065152 00000100:00100000:1.0:1783135596.310177:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 231 00000100:00100000:1.0:1783135596.310191:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+65:12474:x1869752786065152:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135596.310215:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135596.310238:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee093d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f6f expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.310303:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.310316:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee093d lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f6f expref: 66 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.310339:0:8461:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.310353:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee093d lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f6f expref: 66 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.310403:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:1.0:1783135596.310417:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135596.310422:0:8461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee093d lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f6f expref: 66 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.310431:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9a00, rc 0) 00000100:00100000:1.0:1783135596.310834:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:12474:x1869752786065152:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 644us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.310843:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 231 00010000:00010000:2.0:1783135596.400053:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135596.400133:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135596.400140:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135596.400190:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1783135596.400200:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135596.400380:0:13815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809186688:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783135596.400514:0:13815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135596.413301:0:13815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809186688:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135596.420539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135596.421562:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786065280 00000100:00100000:3.0:1783135596.421762:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786065280 00000100:00100000:3.0:1783135596.421901:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 232 00000100:00100000:3.0:1783135596.421912:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:12475:x1869752786065280:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783135596.421949:0:13464:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783135596.422128:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:12475:x1869752786065280:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 174us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135596.422138:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 232 00000100:00100000:3.0:1783135596.431506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.434613:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786065408 00000100:00100000:2.0:1783135596.434628:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786065408 00000100:00100000:2.0:1783135596.434700:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 233 00000100:00100000:2.0:1783135596.434709:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:12475:x1869752786065408:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783135596.434780:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0944 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434798:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0944 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434812:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0944 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434825:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee094b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434850:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee094b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434856:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee094b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434878:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434886:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434892:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135596.434937:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783135596.434941:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135596.434952:0:6524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434962:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0944 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434969:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0944 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434976:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0944 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.434981:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.434986:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0944 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435012:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0944 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435026:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:2.0:1783135596.435029:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.435034:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0944 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435041:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0944 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435054:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee094b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435059:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee094b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435065:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee094b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435071:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.435073:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee094b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435079:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee094b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435884:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8ac67c7a3f00) 00010000:00010000:2.0:1783135596.435892:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.435899:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee094b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435920:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee094b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435940:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435946:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435952:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435957:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.435962:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435967:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435977:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135596.435980:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.435983:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.435988:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0952 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.436107:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:12475:x1869752786065408:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 Request processed in 1376us (4590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.436117:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 233 00000100:00100000:1.0:1783135596.445919:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.446333:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786065664 00000100:00100000:2.0:1783135596.446345:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786065664 00000100:00100000:2.0:1783135596.446544:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 234 00000100:00100000:2.0:1783135596.446557:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+66:12475:x1869752786065664:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135596.446583:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.446604:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0959 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f76 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.446724:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0960 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.446743:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0960 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.446756:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0960 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135596.446772:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783135596.446873:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0960 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.446881:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0960 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.446888:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0960 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.446894:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.446898:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0960 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.446906:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0960 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.446936:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135596.446939:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783135596.446945:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0960 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.446952:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0960 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.446994:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0959 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f76 expref: 68 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.447006:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:2.0:1783135596.447009:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135596.447012:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee0959 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f76 expref: 68 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.447021:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909400, rc 0) 00000100:00100000:2.0:1783135596.447161:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+67:12475:x1869752786065664:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 596us (1242us total) trans 4294967506 rc 301/301 00000100:00100000:2.0:1783135596.447171:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 234 00000100:00100000:3.0:1783135596.457179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.457535:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786065792 00000100:00100000:0.0:1783135596.457564:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786065792 00000100:00100000:0.0:1783135596.457653:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 235 00000100:00100000:0.0:1783135596.457665:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+67:12475:x1869752786065792:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135596.457708:0:13464:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135596.457833:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+67:12475:x1869752786065792:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 171us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135596.457842:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 235 00000100:00100000:3.0:1783135596.467829:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.468340:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786066048 00000100:00100000:2.0:1783135596.468353:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786066048 00000100:00100000:2.0:1783135596.468507:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 236 00000100:00100000:2.0:1783135596.468538:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+67:12475:x1869752786066048:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135596.468560:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.468563:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783135596.468594:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee08fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f5a expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.468634:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:2.0:1783135596.468639:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135596.468656:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee096e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f7d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783135596.469222:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1783135596.469395:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0975 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.469413:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0975 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.469423:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0975 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.469483:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909400/0xf7de4ef628ee096e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f7d expref: 69 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.469500:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0975 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f7d expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.469507:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac67c7a3f00) 00010000:00010000:2.0:1783135596.469510:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135596.469513:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909a00, rc 0) 00000100:00100000:2.0:1783135596.469583:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+68:12475:x1869752786066048:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1066us (1770us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1783135596.469592:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 236 00000100:00100000:3.0:1783135596.478220:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.479432:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786066304 00000100:00100000:2.0:1783135596.479449:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786066304 00000100:00100000:2.0:1783135596.479816:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 237 00000100:00100000:2.0:1783135596.479831:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+68:12475:x1869752786066304:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135596.479914:0:8461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135596.479942:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909a00/0xf7de4ef628ee0975 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f7d expref: 68 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.479963:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac67c7a3f00) 00010000:00010000:2.0:1783135596.479974:0:8461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135596.479998:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0983 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480015:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0983 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480026:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0983 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480041:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee098a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe7412ed8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480047:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee098a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7412ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480053:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee098a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7412ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480140:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0983 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480174:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0983 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480190:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0983 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480195:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.480200:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0983 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480208:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0983 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480216:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:2.0:1783135596.480219:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.480224:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0983 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480229:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee0983 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480238:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee098a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7412ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480244:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee098a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7412ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480249:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee098a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7412ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480254:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.480262:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee098a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7412ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480268:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee098a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe7412ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480276:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe7412ed8 (ffff8ac67c7a3a00) 00010000:00010000:2.0:1783135596.480278:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.480281:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee098a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe7412ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.480287:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee098a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe7412ed8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.480394:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+67:12475:x1869752786066304:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 566us (2184us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783135596.486397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.486618:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786066432 00000100:00100000:1.0:1783135596.486630:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786066432 00000100:00100000:1.0:1783135596.486696:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 238 00000100:00100000:1.0:1783135596.486707:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+68:12475:x1869752786066432:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135596.486728:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135596.486750:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0991 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f84 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.486802:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.486814:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.486826:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.486937:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee0991 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f84 expref: 70 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.486958:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f84 expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.486966:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:1.0:1783135596.486969:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135596.486972:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9c00, rc 0) 00000100:00100000:1.0:1783135596.487042:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+69:12475:x1869752786066432:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 337us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.487059:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 238 00000100:00100000:3.0:1783135596.489888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.491986:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786066688 00000100:00100000:1.0:1783135596.492005:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786066688 00000100:00100000:1.0:1783135596.493954:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 239 00000100:00100000:1.0:1783135596.493980:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+69:12475:x1869752786066688:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135596.494105:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.494148:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.494161:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135596.494387:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1783135596.494397:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 500287308650ns, next at 501287305815ns, rc = 0 00000004:00010000:1.0:1783135596.494458:0:6524:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000489f5159 reply state 00000000a3b4fc8f transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.494473:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.494480:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:1.0:1783135596.494483:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1783135596.494488:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135596.494633:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+71:12475:x1869752786066688:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 663us (4753us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1783135596.494641:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 239 00000100:00100000:2.0:1783135596.495333:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 237 00000100:00100000:3.0:1783135596.505065:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.505291:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786066816 00000100:00100000:1.0:1783135596.505304:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786066816 00000100:00100000:1.0:1783135596.505361:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 240 00000100:00100000:1.0:1783135596.505385:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+70:12475:x1869752786066816:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135596.505412:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135596.505433:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee09a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.505524:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee09a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f8b expref: 71 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.505540:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee09a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f8b expref: 71 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.505560:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:1.0:1783135596.505564:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135596.505567:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9e00, rc 0) 00000100:00100000:1.0:1783135596.505642:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+71:12475:x1869752786066816:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 270us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.505649:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 240 00000100:00100000:3.0:1783135596.515689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.515787:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786066944 00000100:00100000:2.0:1783135596.515801:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786066944 00000100:00100000:2.0:1783135596.515869:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 71 00000100:00100000:2.0:1783135596.515880:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2401:x1869752786066944:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783135596.516170:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2401:x1869752786066944:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 291us (494us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1783135596.516185:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 71 00000100:00100000:3.0:1783135596.524606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.525084:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786067200 00000100:00100000:1.0:1783135596.525131:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786067200 00000100:00100000:1.0:1783135596.525189:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:1.0:1783135596.525199:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+71:12475:x1869752786067200:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783135596.525440:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+72:12475:x1869752786067200:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 242us (844us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1783135596.525448:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:3.0:1783135596.534451:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.534610:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786067456 00000100:00100000:0.0:1783135596.534622:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786067456 00000100:00100000:0.0:1783135596.534711:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 241 00000100:00100000:0.0:1783135596.534725:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+72:12475:x1869752786067456:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783135596.534868:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+72:12475:x1869752786067456:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 145us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135596.534877:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 241 00000100:00100000:3.0:1783135596.545669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.545780:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786067584 00000100:00100000:2.0:1783135596.545794:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786067584 00000100:00100000:2.0:1783135596.545871:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 242 00000100:00100000:2.0:1783135596.545881:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+72:12475:x1869752786067584:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135596.545942:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.545968:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee09ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f92 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.546343:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee09b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.546364:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee09b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.546387:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee09b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135596.546445:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135596.546467:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee09b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.546499:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908800/0xf7de4ef628ee09ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f92 expref: 74 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.546604:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee09b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f92 expref: 73 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.546616:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:2.0:1783135596.546619:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783135596.546624:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909000, rc 0) 00000100:00100000:2.0:1783135596.546791:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+73:12475:x1869752786067584:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 911us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.546801:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 242 00000100:00100000:0.0:1783135596.558756:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.558858:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786067712 00000100:00100000:2.0:1783135596.558871:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786067712 00000100:00100000:2.0:1783135596.559010:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:2.0:1783135596.559023:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+10:2400:x1869752786067712:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135596.559048:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.559083:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f2496c7/0xf7de4ef628ee09bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140f99 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135596.559143:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487d6d, blocks: 0x0 00010000:00010000:2.0:1783135596.559168:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=500s v=(0 0) 00010000:00010000:2.0:1783135596.559172:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135596.559193:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f2496c7/0xf7de4ef628ee09bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f99 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.559213:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f2496c7/0xf7de4ef628ee09bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f99 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.559229:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908800, rc 0) 00000100:00100000:2.0:1783135596.559297:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:2400:x1869752786067712:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 277us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.559305:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:3.0:1783135596.573862:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.573951:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786067968 00000100:00100000:0.0:1783135596.573964:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786067968 00000100:00100000:0.0:1783135596.574138:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 243 00000100:00100000:0.0:1783135596.574152:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+73:12475:x1869752786067968:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783135596.574310:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+73:12475:x1869752786067968:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 161us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135596.574319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 243 00000100:00100000:0.0:1783135596.580692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.580812:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786068096 00000100:00100000:2.0:1783135596.580823:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786068096 00000100:00100000:2.0:1783135596.580937:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:2.0:1783135596.580948:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:12475:x1869752786068096:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135596.580969:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.581003:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140fa0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.581043:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f2496c7/0xf7de4ef628ee09bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f99 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.581052:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135596.581056:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135596.581060:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.581135:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f2496c7/0xf7de4ef628ee09bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f99 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.581151:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f2496c7/0xf7de4ef628ee09bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f99 expref: 12 pid: 8435 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.581167:0:8437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1869752809186816:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135596.581285:0:8437:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642e8e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135596.587708:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.587796:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786068224 00000100:00100000:0.0:1783135596.587808:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786068224 00010000:00010000:0.0:1783135596.587867:0:10344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f2496c7/0xf7de4ef628ee09bb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f99 expref: 13 pid: 8435 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.587932:0:8437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1869752809186816:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135596.587938:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 101 00000100:00100000:0.0:1783135596.587953:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:2401:x1869752786068224:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135596.587970:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135596.587971:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.587992:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909a00, rc 0) 00010000:00010000:0.0:1783135596.587998:0:10344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f2496c7/0xf7de4ef628ee09bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f99 expref: 13 pid: 8435 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.588015:0:10344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f2496c7/0xf7de4ef628ee09bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f99 expref: 13 pid: 8435 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.588040:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f2496c7/0xf7de4ef628ee09bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f99 expref: 13 pid: 8435 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.588058:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:12475:x1869752786068096:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 7110us (7373us total) trans 0 rc 0/0 00010000:00010000:0.0:1783135596.588068:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135596.588076:0:10344:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1783135596.588084:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 73 00010000:00010000:0.0:1783135596.588130:0:10344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.588144:0:10344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.588385:0:10344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135596.588401:0:10344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10344:1869752809186944:192.168.204.6@tcp:105: 00000100:00100000:0.0:1783135596.588484:0:10344:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135596.593572:0:10344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10344:1869752809186944:192.168.204.6@tcp:105: 00010000:00010000:0.0:1783135596.593610:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135596.593682:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:2401:x1869752786068224:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 5732us (5985us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135596.593694:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 101 00000100:00100000:3.0:1783135596.596034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.596434:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786068352 00000100:00100000:2.0:1783135596.596446:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786068352 00002000:00100000:2.0:1783135596.596518:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8ac6434f6680 x1869752786068352/t0(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:12/0 lens 504/0 e 0 to 0 dl 1783135607 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135596.596530:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac6434f6680 with x1869752786068352 ext(0->12) 00002000:00010000:2.0:1783135596.596537:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac6434f6680 00000100:00100000:2.0:1783135596.596577:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:2.0:1783135596.596588:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+11:2399:x1869752786068352:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783135596.598072:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:2399:x1869752786068352:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 Request processed in 1476us (2035us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1783135596.598125:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00002000:00100000:2.0:1783135596.598137:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8ac6434f6680 x1869752786068352/t4294967322(0) o4->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:12/0 lens 504/448 e 0 to 0 dl 1783135607 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135596.598147:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac6434f6680 with x1869752786068352 ext(0->12) 00002000:00010000:2.0:1783135596.598153:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac6434f6680 00000100:00100000:1.0:1783135596.605243:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.605482:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786068480 00000100:00100000:2.0:1783135596.605575:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786068480 00000100:00100000:2.0:1783135596.605649:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 244 00000100:00100000:2.0:1783135596.605662:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+73:12475:x1869752786068480:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783135596.616723:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:3.0:1783135596.616746:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1783135596.616789:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1783135596.616809:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ac5438829c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1783135596.616815:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac659ae8900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ac543882600 00000020:00080000:3.0:1783135596.616834:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac659ae8600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac543a0e200 00000004:00080000:3.0:1783135596.616864:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1783135596.616887:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ac54317a840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1783135596.616889:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac652ab8800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ac54317a600 00000020:00080000:3.0:1783135596.616892:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac652ab8c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac67c5ad200 00000100:00100000:3.0:1783135596.617070:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:12475:x1869752786068480:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 Request processed in 11406us (11835us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135596.617081:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 244 00000020:00080000:0.0:1783135596.617407:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1783135596.617471:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1783135596.617481:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135596.617510:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809187072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783135596.617572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135596.617616:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809187200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783135596.617643:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135596.617677:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809187072 00000100:00100000:0.0:1783135596.617686:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809187072 00000100:00100000:0.0:1783135596.617734:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809187200 00000100:00100000:0.0:1783135596.617738:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809187200 00000100:00100000:0.0:1783135596.617761:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135596.617770:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809187072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783135596.617798:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1783135596.617830:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.617851:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee077d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef8 expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.617861:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1783135596.617875:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135596.617880:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.617911:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee077d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef8 expref: 12 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.617924:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee077d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef8 expref: 12 pid: 8438 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135596.617937:0:8435:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1869752809187328:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135596.617987:0:8435:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1783135596.618000:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135596.618014:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783135596.618022:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1869752809187200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783135596.618159:0:8620:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783135596.618163:0:8620:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1783135597 00002000:00010000:0.0:1783135596.618165:0:8620:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783135596.618167:0:8620:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783135597 -> 1783135597 00002000:00010000:0.0:1783135596.618170:0:8620:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1783135596.618209:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1869752809187200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 187us (565us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1783135596.618216:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783135596.618253:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:0.0:1783135596.618259:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:0.0:1783135596.618281:0:3646:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8ac543b71880 x1869752809187200/t4294967323(4294967323) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1783135612 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783135596.618300:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac543b71880/2, rc 0, transno 4294967323 00000100:00100000:0.0:1783135596.618305:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809187200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783135596.618892:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135596.618905:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809187456:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783135596.618944:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135596.618975:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809187456 00000100:00100000:1.0:1783135596.618988:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809187456 00000100:00100000:1.0:1783135596.619019:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783135596.619026:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3646:x1869752809187456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783135596.619041:0:8620:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1783135596.619071:0:8620:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a487d6c, atime: 0x6a487d6c, ctime: 0x6a487d6c, blocks: 0x8 00010000:00010000:1.0:1783135596.619077:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee09d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.619110:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1783135596.619113:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135596.619119:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee09d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.619137:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee09d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.619149:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee09d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.619157:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee09d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.619177:0:8620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783135596.619327:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3646:x1869752809187456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 300us (381us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783135596.619334:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:1.0:1783135596.619355:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135596.619381:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee09d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.619390:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8e00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135596.619395:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee09d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.619414:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee09d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.619432:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee09d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.619440:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee09d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.619459:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135596.619461:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135596.619462:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783135596.619487:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac67f885180/2, rc 0, transno 4294967311 00000100:00100000:1.0:1783135596.619611:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809187456:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783135596.623904:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.623923:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.623951:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.623958:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.623963:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.623970:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.623989:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ac67c7a3200) 00010000:00010000:2.0:1783135596.623993:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.623998:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624003:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909200/0xf7de4ef628ee06c7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624053:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624058:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624063:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624067:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.624069:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624082:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624144:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ac67c491600) 00010000:00010000:2.0:1783135596.624146:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.624150:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624155:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526e00/0xf7de4ef628ee076f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624172:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624176:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624182:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624185:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.624188:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624192:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624198:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c491400) 00010000:00010000:2.0:1783135596.624200:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.624203:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624214:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee07ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624225:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624229:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624234:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624239:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.624241:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624487:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624501:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c491400) 00010000:00010000:2.0:1783135596.624503:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.624506:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624511:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989600/0xf7de4ef628ee0810 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624530:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624535:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624562:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624567:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.624570:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624915:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624930:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135596.624932:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.624936:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624942:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee08e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624958:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624964:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624971:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624976:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.624979:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.624995:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.625003:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:2.0:1783135596.625005:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783135596.625008:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.625079:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee099f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135596.626685:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1783135596.626707:0:9520:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1783135596.631043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.631191:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786068608 00000100:00100000:2.0:1783135596.631205:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786068608 00010000:00010000:2.0:1783135596.631263:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee077d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef8 expref: 13 pid: 8438 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135596.631304:0:8435:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1869752809187328:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135596.631316:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:2.0:1783135596.631330:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+13:2400:x1869752786068608:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135596.631343:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631351:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135596.631360:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee077d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef8 expref: 13 pid: 8438 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631387:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee077d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef8 expref: 13 pid: 8438 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631425:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee077d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ef8 expref: 13 pid: 8438 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631464:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135596.631468:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135596.631474:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631485:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631515:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135596.631546:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.631557:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.631567:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:2400:x1869752786068608:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 238us (534us total) trans 0 rc 0/0 00010000:00010000:0.0:1783135596.631569:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.631583:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.631590:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 102 00010000:00010000:0.0:1783135596.631603:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135596.631648:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135596.631655:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631664:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988800 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135596.631668:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631679:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631692:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631711:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004203e689/0xf7de4ef628ee09c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.631734:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135596.631736:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135596.631738:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135596.631794:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1869752809187072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14024us (14220us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1783135596.631803:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:2.0:1783135596.632258:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac543b71f80/2, rc 0, transno 4294967324 00000100:00100000:2.0:1783135596.632266:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809187072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783135596.640485:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.640595:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786068736 00000100:00100000:2.0:1783135596.640607:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786068736 00000100:00100000:2.0:1783135596.640671:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:2.0:1783135596.640682:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+12:2401:x1869752786068736:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1783135596.643968:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1783135596.643986:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:2.0:1783135596.644231:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2401:x1869752786068736:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 Request processed in 3541us (3824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.644245:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:3.0:1783135596.650084:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.650288:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786068992 00000100:00100000:1.0:1783135596.650299:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786068992 00000100:00100000:1.0:1783135596.650380:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 245 00000100:00100000:1.0:1783135596.650392:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:12475:x1869752786068992:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135596.650695:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135596.650743:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909000/0xf7de4ef628ee09b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f92 expref: 21 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.650767:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:1.0:1783135596.650772:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135596.650809:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.650823:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.650833:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135596.650976:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050d6532d reply state 00000000ddf11dce transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.650990:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.650996:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:1.0:1783135596.650999:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135596.651002:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135596.652966:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:12475:x1869752786068992:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 2564us (2884us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1783135596.652983:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 245 00000100:00100000:1.0:1783135596.682673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.683565:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786069120 00000100:00100000:0.0:1783135596.683591:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786069120 00000100:00100000:0.0:1783135596.683679:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:0.0:1783135596.683691:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786069120:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783135596.683889:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783135596.683893:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1783135597 -> 1783135596 00002000:00010000:0.0:1783135596.683896:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1783135596 00002000:00010000:0.0:1783135596.683898:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1783135597 -> 1783135596 00002000:00010000:0.0:1783135596.683900:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1783135596.683983:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786069120:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 294us (1322us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1783135596.683991:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:0.0:1783135596.696675:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.696940:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786069376 00000100:00100000:1.0:1783135596.696951:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786069376 00000100:00100000:1.0:1783135596.697020:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 246 00000100:00100000:1.0:1783135596.697032:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:12475:x1869752786069376:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783135596.697154:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.697173:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f84 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.697184:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.697221:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f84 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.697235:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f84 expref: 22 pid: 6523 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135596.697250:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543961f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809187584:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135596.697338:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135596.706062:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543961f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809187584:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135596.707079:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135596.713939:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.714058:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786069504 00000100:00100000:1.0:1783135596.714071:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786069504 00010000:00010000:1.0:1783135596.714166:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f84 expref: 23 pid: 6523 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135596.714215:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 103 00000100:00100000:1.0:1783135596.714225:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+23:2400:x1869752786069504:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135596.714260:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135596.714268:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f84 expref: 23 pid: 6523 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.714283:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f84 expref: 23 pid: 6523 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.714308:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9c00/0xf7de4ef628ee0998 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f84 expref: 23 pid: 6523 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.714328:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:1.0:1783135596.714333:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.714344:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.714352:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.714383:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135596.714454:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:2400:x1869752786069504:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 230us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.714461:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 103 00010000:00010000:2.0:1783135596.716898:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.716918:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.716971:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.716978:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.717009:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.717015:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.717020:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.717028:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.717051:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:2.0:1783135596.717055:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783135596.717060:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.717066:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9800/0xf7de4ef628ee09de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.717238:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:12475:x1869752786069376:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 Request processed in 20201us (20568us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783135596.717250:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 246 00000100:00100000:0.0:1783135596.721840:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.723000:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786069632 00000100:00100000:1.0:1783135596.723016:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786069632 00000100:00100000:1.0:1783135596.723111:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:1.0:1783135596.723124:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786069632:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783135596.723208:0:8620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.723231:0:8620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.723241:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135596.723245:0:8620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135596.723249:0:8620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.724194:0:8620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.724212:0:8620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 8 pid: 8437 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135596.724230:0:8620:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543961f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8620:1869752809187712:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135596.724789:0:8620:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135596.733459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.733735:0:8620:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543961f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8620:1869752809187712:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135596.733770:0:8620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135596.733949:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786069760 00000100:00100000:3.0:1783135596.733956:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786069760 00010000:00010000:3.0:1783135596.734001:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 9 pid: 8437 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135596.734049:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:3.0:1783135596.734060:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+9:2400:x1869752786069760:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135596.734076:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135596.734136:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 9 pid: 8437 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.734151:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 9 pid: 8437 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.734183:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee09c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa0 expref: 9 pid: 8437 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.734221:0:10346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135596.734225:0:10346:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135596.734231:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.734241:0:10346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.734264:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135596.734338:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786069760:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 278us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135596.734358:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 104 00010000:00010000:1.0:1783135596.734592:0:8620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.734615:0:8620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.734638:0:8620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.734646:0:8620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.734654:0:8620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.734661:0:8620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e800 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135596.734666:0:8620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.734675:0:8620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.734689:0:8620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.734696:0:8620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000280be57c/0xf7de4ef628ee09e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135596.734777:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786069632:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 Request processed in 11656us (12950us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.734787:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:0.0:1783135596.746912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135596.748295:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786070016 00000100:00100000:3.0:1783135596.748309:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786070016 00000100:00100000:3.0:1783135596.748404:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 247 00000100:00100000:3.0:1783135596.748417:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:12475:x1869752786070016:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783135596.749672:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.749709:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f4c expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.749721:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.749767:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f4c expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.749801:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f4c expref: 21 pid: 6522 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135596.749820:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809187840:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135596.749933:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135596.762038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135596.762153:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809187840:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135596.762184:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.762341:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786070144 00000100:00100000:2.0:1783135596.762428:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786070144 00010000:00010000:2.0:1783135596.762472:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f4c expref: 22 pid: 6522 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.762719:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 105 00000100:00100000:2.0:1783135596.762731:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:2401:x1869752786070144:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135596.762766:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135596.762773:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f4c expref: 22 pid: 6522 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.762785:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f4c expref: 22 pid: 6522 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.762814:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8c00/0xf7de4ef628ee08db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f4c expref: 22 pid: 6522 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.762835:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135596.762841:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee093d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f6f expref: 21 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.762851:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.762859:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.762868:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.762897:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135596.762972:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:2401:x1869752786070144:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 242us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.762981:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 105 00010000:00010000:3.0:1783135596.763515:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.763524:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.763739:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.763756:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee09a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f8b expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.763767:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.763806:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee09a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f8b expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.763822:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee09a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f8b expref: 21 pid: 6523 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135596.763850:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809187968:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135596.763943:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543987a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135596.778431:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.778856:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786070272 00000100:00100000:1.0:1783135596.778867:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786070272 00010000:00010000:1.0:1783135596.778916:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee09a6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f8b expref: 22 pid: 6523 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135596.778971:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 106 00000100:00100000:1.0:1783135596.778981:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac648bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:2399:x1869752786070272:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135596.779003:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135596.779011:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee09a6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f8b expref: 22 pid: 6523 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.779027:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee09a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f8b expref: 22 pid: 6523 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135596.779048:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809187968:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135596.779056:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9e00/0xf7de4ef628ee09a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f8b expref: 22 pid: 6523 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.779082:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:3.0:1783135596.779083:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.782389:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.782407:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.782446:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.782683:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135596.782792:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac648bc4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:2399:x1869752786070272:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 3806us (4366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.782804:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 106 00010000:00010000:3.0:1783135596.784595:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.784614:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135596.784784:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1783135596.784946:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:3.0:1783135596.784984:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1783135596.785074:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1869752809188096:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783135596.785194:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135596.785229:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135596.786701:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809188096 00000100:00100000:0.0:1783135596.786722:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809188096 00000100:00100000:0.0:1783135596.786813:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1783135596.786826:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1869752809188096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783135596.786985:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1869752809188096:12345-0@lo:1000:mdt00_002.0 Request processed in 161us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135596.786994:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1783135596.788379:0:6524:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1783135596.788390:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac543b71880, transno 4294967323 00000004:00080000:3.0:1783135596.788575:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac543b71f80, transno 4294967324 00000100:00100000:3.0:1783135596.788590:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1869752809188096:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1783135596.788778:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:3.0:1783135596.788868:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1869752809188224:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783135596.788930:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135596.792880:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543987e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135596.796228:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809188224 00000100:00100000:1.0:1783135596.796244:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809188224 00000100:00100000:1.0:1783135596.796405:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1783135596.796489:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1869752809188224:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783135596.796743:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1869752809188224:12345-0@lo:1000:mdt00_002.0 Request processed in 259us (7812us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1783135596.796853:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1869752809188224:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783135596.796928:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.796939:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.796947:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.796954:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682173000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135596.796959:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.796967:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.796988:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:0.0:1783135596.796992:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135596.796997:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.797004:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee09f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.797033:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.797040:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.797046:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.797062:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135596.797065:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.797071:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.797080:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:0.0:1783135596.797083:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135596.797123:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee093d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f6f expref: 24 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.797136:0:6524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee093d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f6f expref: 24 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.797145:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee093d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f6f expref: 24 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.797183:0:6524:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee093d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f6f expref: 24 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135596.797198:0:6524:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543795500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809188352:192.168.204.6@tcp:105: 00000100:00100000:0.0:1783135596.797300:0:6524:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d900 going to sleep for 11 seconds 00000100:00100000:3.0:1783135596.802559:0:6524:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543795500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1869752809188352:192.168.204.6@tcp:105: 00010000:00010000:3.0:1783135596.802604:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.802617:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650989000/0xf7de4ef628ee0936 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.802660:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee09fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.802676:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee09fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.802691:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee09fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135596.802773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.802811:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786070400 00000100:00100000:0.0:1783135596.802820:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786070400 00000100:00100000:0.0:1783135596.802885:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:0.0:1783135596.802895:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:12474:x1869752786070400:12345-192.168.204.6@tcp:49:lfs.0 00000100:00100000:0.0:1783135596.803054:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+25:12474:x1869752786070400:12345-192.168.204.6@tcp:49:lfs.0 Request processed in 160us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135596.803062:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 61 00010000:00010000:3.0:1783135596.803861:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee09fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803871:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee09fa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803878:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee09fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803883:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135596.803888:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee09fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803894:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee09fa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803910:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:3.0:1783135596.803922:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135596.803927:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee09fa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803932:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee09fa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803947:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803953:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803959:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803964:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135596.803966:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803972:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803979:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:3.0:1783135596.803981:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135596.803984:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.803989:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee09ec lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135596.804164:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:12475:x1869752786070016:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 55748us (57261us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1783135596.804182:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 247 00000020:00080000:3.0:1783135596.804186:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1783135596.804548:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000040:00080000:0.0:1783135596.804614:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135596.804619:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135596.806675:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1783135596.806693:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135596.807542:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135596.807806:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786070656 00000100:00100000:1.0:1783135596.807816:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786070656 00000100:00100000:1.0:1783135596.807878:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 248 00000100:00100000:1.0:1783135596.807888:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:12474:x1869752786070656:12345-192.168.204.6@tcp:58:lfs.0 00000040:00080000:1.0:1783135596.808070:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1783135596.808583:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:12474:x1869752786070656:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 693us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.808593:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 248 00000100:00100000:1.0:1783135596.810844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135596.810929:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786070912 00000100:00100000:0.0:1783135596.810939:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786070912 00000100:00100000:0.0:1783135596.810999:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:0.0:1783135596.811012:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660a8f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+24:12475:x1869752786070912:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783135596.811326:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783135596.811373:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:0.0:1783135596.811422:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.811440:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.811452:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.811461:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.811468:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.811474:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.811516:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783135596.811595:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660a8f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+26:12475:x1869752786070912:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 585us (760us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1783135596.811603:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 62 00000020:00080000:0.0:1783135596.811608:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783135596.812342:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135596.812351:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.812359:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988400 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135596.812373:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.812382:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.812406:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:3.0:1783135596.812409:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783135596.812414:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.812420:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988400/0xf7de4ef628ee0a01 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.812434:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135596.812435:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135596.812437:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135596.873884:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.879434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786071040 00000100:00100000:2.0:1783135596.879472:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786071040 00000100:00100000:2.0:1783135596.879619:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 249 00000100:00100000:2.0:1783135596.879633:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+26:12477:x1869752786071040:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135596.879660:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.879683:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0a08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140fa7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.879771:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0a0f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.879788:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0a0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.879800:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0a0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.879815:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0a16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.879823:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.879829:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.879922:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.879932:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f68 expref: 27 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.879941:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.880000:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f68 expref: 27 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.880015:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f68 expref: 27 pid: 13464 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.880029:0:6522:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809188480:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135596.880165:0:6522:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642e8e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135596.885288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135596.885769:0:6522:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1869752809188480:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135596.885806:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135596.885971:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786071296 00000100:00100000:0.0:1783135596.885981:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786071296 00000100:00100000:0.0:1783135596.886054:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:0.0:1783135596.886065:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+28:6172:x1869752786071296:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783135596.890101:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:6172:x1869752786071296:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 4005us (4794us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1783135596.890143:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:1.0:1783135596.901471:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135596.901797:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786071424 00000100:00100000:3.0:1783135596.901808:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786071424 00010000:00010000:3.0:1783135596.903389:0:10346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f68 expref: 29 pid: 13464 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135596.903871:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 107 00000100:00100000:3.0:1783135596.903914:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:2400:x1869752786071424:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135596.903937:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135596.903946:0:10346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f68 expref: 29 pid: 13464 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.903972:0:10346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f68 expref: 29 pid: 13464 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.903997:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0928 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f68 expref: 29 pid: 13464 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.904021:0:10346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:3.0:1783135596.904026:0:10346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.904038:0:10346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.904047:0:10346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135596.904135:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135596.904206:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+28:2400:x1869752786071424:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 303us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135596.904214:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 107 00010000:00010000:2.0:1783135596.904295:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904304:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135596.904384:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783135596.904390:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135596.904422:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904436:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904447:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0a0f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904464:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0a0f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904471:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0a0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904477:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.904481:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0a0f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904490:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0a0f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904500:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:2.0:1783135596.904502:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.904506:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0a0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904511:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909800/0xf7de4ef628ee0a0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904523:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904529:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0a16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904534:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0a16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904539:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135596.904547:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0a16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904553:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0a16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904574:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ac67c7a3200) 00010000:00010000:2.0:1783135596.904577:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135596.904580:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0a16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904585:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908400/0xf7de4ef628ee0a16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904622:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908a00/0xf7de4ef628ee0a08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa7 expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904634:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa7 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.904641:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135596.904643:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135596.904645:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908c00, rc 0) 00000100:00100000:2.0:1783135596.904673:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:12477:x1869752786071040:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 25044us (30800us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.904680:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 249 00000100:00100000:2.0:1783135596.918659:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809188608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135596.918754:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135596.919795:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809188608 00000100:00100000:3.0:1783135596.919808:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809188608 00000100:00100000:3.0:1783135596.919867:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783135596.919877:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809188608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135596.919933:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1783135596.923594:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809188608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3708us (4831us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135596.923611:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1783135596.923881:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809188608:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783135597.430655:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135597.871529:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135597.871556:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135597.871592:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783135597.871602:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135597.871757:0:13815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543795f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809188736:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135597.871852:0:13815:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317df00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135597.879831:0:13815:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543795f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13815:1869752809188736:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135597.885714:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135597.885999:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786071552 00000100:00100000:3.0:1783135597.886009:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786071552 00000100:00100000:3.0:1783135597.886067:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 250 00000100:00100000:3.0:1783135597.886076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:12488:x1869752786071552:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783135597.886141:0:6524:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783135597.886258:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:12488:x1869752786071552:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 181us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135597.886267:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 250 00000100:00100000:0.0:1783135597.889974:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135597.890136:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786071808 00000100:00100000:3.0:1783135597.890148:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786071808 00000100:00100000:3.0:1783135597.890201:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 251 00000100:00100000:3.0:1783135597.890210:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+27:12488:x1869752786071808:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135597.890245:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135597.890265:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee0a24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140fae expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135597.890410:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0a2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135597.890426:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0a2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135597.890438:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0a2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135597.890467:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783135597.890602:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee0a24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fae expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135597.890624:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0a2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fae expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135597.890632:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:3.0:1783135597.890635:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135597.890638:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac682172e00, rc 0) 00000100:00100000:3.0:1783135597.890701:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:12488:x1869752786071808:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 490us (737us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1783135597.890709:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 251 00000100:00100000:0.0:1783135597.897607:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135597.897792:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786071936 00000100:00100000:2.0:1783135597.897804:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786071936 00000100:00100000:2.0:1783135597.898014:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:2.0:1783135597.898025:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:2398:x1869752786071936:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135597.898043:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135597.898081:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172e00/0xf7de4ef628ee0a2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fae expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.898116:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135597.898124:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135597.898176:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+28:2398:x1869752786071936:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 153us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135597.898184:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:3.0:1783135597.905359:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135597.905459:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786072192 00000100:00100000:0.0:1783135597.905470:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786072192 00000100:00100000:0.0:1783135597.905536:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 252 00000100:00100000:0.0:1783135597.905548:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+28:12488:x1869752786072192:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783135597.905637:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0a39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.905673:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0a39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.905686:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0a39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.905839:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0a39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.905847:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0a39 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.905853:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0a39 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.905858:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135597.905862:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0a39 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.905870:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0a39 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.905882:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:0.0:1783135597.905885:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135597.905890:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0a39 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.905896:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac650988000/0xf7de4ef628ee0a39 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135597.906013:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:12488:x1869752786072192:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 467us (676us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1783135597.906030:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 252 00000040:00080000:0.0:1783135597.906244:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135597.906249:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135597.906758:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783135597.906767:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135597.925786:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135597.937729:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786072448 00000100:00100000:3.0:1783135597.937747:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786072448 00000100:00100000:3.0:1783135597.937822:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:3.0:1783135597.937833:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+29:12488:x1869752786072448:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783135597.938068:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:12488:x1869752786072448:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 236us (12293us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1783135597.938077:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 64 00000040:00080000:0.0:1783135597.942955:0:14674:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135597.942967:0:14674:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135597.942999:0:14674:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783135597.943005:0:14674:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135598.137246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135598.137284:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135598.137319:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135598.137353:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135598.137385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135598.137413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135598.137440:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786073088 00000100:00100000:1.0:1783135598.137451:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786073088 00000100:00100000:1.0:1783135598.137536:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786072704 00000100:00100000:1.0:1783135598.137540:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786072704 00000100:00100000:1.0:1783135598.137560:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786073216 00000100:00100000:1.0:1783135598.137563:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786073216 00000100:00100000:1.0:1783135598.137581:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 377 00000100:00100000:1.0:1783135598.137592:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752786073088:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135598.137686:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752786073088:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 95us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.137693:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 377 00000100:00100000:1.0:1783135598.137713:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 378 00000100:00100000:1.0:1783135598.137720:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752786072704:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135598.137745:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752786072704:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.137752:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 378 00000100:00100000:1.0:1783135598.137763:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 379 00000100:00100000:1.0:1783135598.137768:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752786073216:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135598.137814:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752786073216:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 44us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.137820:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 379 00000100:00100000:1.0:1783135598.137849:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786072832 00000100:00100000:1.0:1783135598.137853:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786072832 00000100:00100000:1.0:1783135598.137881:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786072960 00000100:00100000:1.0:1783135598.137884:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786072960 00000100:00100000:1.0:1783135598.137905:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 107 00000100:00100000:1.0:1783135598.137911:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2398:x1869752786072832:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135598.137937:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2398:x1869752786072832:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.137943:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 107 00000100:00100000:1.0:1783135598.137954:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 108 00000100:00100000:1.0:1783135598.137960:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752786072960:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135598.137982:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752786072960:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 22us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.137988:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 108 00000100:00080000:1.0:1783135598.138007:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135598.138011:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135598.138013:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135598.138016:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135598.138969:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786072576 00000100:00100000:3.0:1783135598.138980:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786072576 00000100:00100000:3.0:1783135598.139042:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 401 00000100:00100000:3.0:1783135598.139052:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752786072576:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135598.139155:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752786072576:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 104us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.139162:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 401 00000100:00100000:1.0:1783135598.200828:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135598.202306:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786073472 00000100:00100000:3.0:1783135598.202323:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786073472 00000100:00100000:3.0:1783135598.202411:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 253 00000100:00100000:3.0:1783135598.202421:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+30:12501:x1869752786073472:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1783135598.202449:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135598.202473:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee0a40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140fb5 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.202608:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee0a47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.202624:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee0a47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.202636:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee0a47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135598.202647:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783135598.202756:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172a00/0xf7de4ef628ee0a40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fb5 expref: 33 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.202774:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee0a47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fb5 expref: 32 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.202784:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:3.0:1783135598.202804:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783135598.202808:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac682172800, rc 0) 00000100:00100000:3.0:1783135598.202871:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:12501:x1869752786073472:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 451us (2055us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1783135598.202878:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 253 00000100:00080000:1.0:1783135598.207035:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135598.219957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135598.220006:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786073600 00000100:00100000:3.0:1783135598.220018:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786073600 00000100:00100000:3.0:1783135598.220080:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 254 00000100:00100000:3.0:1783135598.220110:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:12501:x1869752786073600:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:3.0:1783135598.221138:0:13464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0a55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.221164:0:13464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0a55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.221488:0:13464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0a55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.221601:0:13464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0a55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.221611:0:13464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0a55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.221619:0:13464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0a55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.221625:0:13464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682173000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135598.221629:0:13464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0a55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.221653:0:13464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0a55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.221667:0:13464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:3.0:1783135598.221670:0:13464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135598.221675:0:13464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0a55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.221681:0:13464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682173000/0xf7de4ef628ee0a55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135598.221848:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+32:12501:x1869752786073600:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 1755us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.221858:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 254 00000040:00080000:0.0:1783135598.320009:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783135598.388359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135598.391576:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786073728 00000100:00100000:2.0:1783135598.391602:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786073728 00000100:00100000:2.0:1783135598.391708:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:2.0:1783135598.391720:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786073728:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:2.0:1783135598.391743:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135598.391769:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0a5c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140fbc expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135598.391800:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a487d6c, atime: 0x6a487d6c, ctime: 0x6a487d6c, blocks: 0x8 00010000:00010000:2.0:1783135598.391825:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=502s v=(0 0) 00010000:00010000:2.0:1783135598.391830:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135598.391858:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0a5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fbc expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135598.391883:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0a5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fbc expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135598.391899:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909c00, rc 0) 00000100:00100000:2.0:1783135598.391976:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2400:x1869752786073728:12345-192.168.204.6@tcp:101:cat.0 Request processed in 257us (3640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135598.391993:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:3.0:1783135598.417901:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135598.418019:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786073856 00000100:00100000:0.0:1783135598.418029:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786073856 00002000:00100000:0.0:1783135598.418142:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8ac6434f7100 x1869752786073856/t0(0) o3->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:14/0 lens 488/0 e 0 to 0 dl 1783135609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135598.418155:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac6434f7100 with x1869752786073856 ext(0->4095) 00002000:00010000:0.0:1783135598.418171:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac6434f7100 00000100:00100000:0.0:1783135598.418211:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:0.0:1783135598.418221:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786073856:12345-192.168.204.6@tcp:3:cat.0 00000100:00100000:0.0:1783135598.418398:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+8:2401:x1869752786073856:12345-192.168.204.6@tcp:3:cat.0 Request processed in 177us (509us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783135598.418406:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00002000:00100000:0.0:1783135598.418412:0:8442:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8ac6434f7100 x1869752786073856/t0(0) o3->393908cf-d54e-4d7c-b6e6-bcde2fa6fefe@192.168.204.6@tcp:14/0 lens 488/4536 e 0 to 0 dl 1783135609 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135598.418419:0:8442:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8ac6434f7100 with x1869752786073856 ext(0->4095) 00002000:00010000:0.0:1783135598.418439:0:8442:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ac6434f7100 00010000:00010000:1.0:1783135598.446383:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135598.958440:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809188864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135598.958558:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783135598.959118:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135598.959125:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135598.959147:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783135598.959154:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135598.959536:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809188864 00000100:00100000:3.0:1783135598.959544:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809188864 00000100:00080000:1.0:1783135598.959867:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135598.959915:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135598.959929:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809189248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135598.959977:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135598.960079:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809189376:0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960126:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135598.960151:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809189888:0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960175:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135598.960191:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809190400:0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960212:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135598.960229:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783135598.960234:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809189760:0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960257:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135598.960274:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809190272:0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960293:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135598.960318:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809189888 00000100:00100000:1.0:1783135598.960321:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809189888 00000100:00100000:1.0:1783135598.960381:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783135598.960400:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809189888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960460:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809189888:12345-0@lo:400:kworker.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.960467:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1783135598.960493:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809190400 00000100:00100000:1.0:1783135598.960496:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809190400 00000100:00100000:1.0:1783135598.960537:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809190272 00000100:00100000:1.0:1783135598.960552:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809190272 00000100:00100000:1.0:1783135598.960576:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783135598.960596:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1869752809190400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960627:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1869752809190400:12345-0@lo:400:kworker.0 Request processed in 45us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.960633:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783135598.960645:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783135598.960650:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809190272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960675:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809190272:12345-0@lo:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.960680:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783135598.960696:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809189760 00000100:00100000:1.0:1783135598.960699:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809189760 00000100:00100000:1.0:1783135598.960738:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1783135598.960744:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809189760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960774:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809189760:12345-0@lo:400:kworker.0 Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.960780:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:1.0:1783135598.960800:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135598.960832:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809189760:0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960843:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809190272:0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960851:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809189888:0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960858:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809190400:0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960897:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809189376 00000100:00100000:1.0:1783135598.960900:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809189376 00000100:00100000:1.0:1783135598.960932:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1783135598.960937:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809189376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135598.960971:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809189376:12345-0@lo:400:kworker.0 Request processed in 34us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.960978:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1783135598.961009:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809189376:0@lo:400:kworker.0 00000100:00100000:3.0:1783135598.961118:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809189248 00000100:00100000:3.0:1783135598.961123:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809189248 00000100:00100000:3.0:1783135598.961148:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783135598.961154:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809188864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135598.961178:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135598.961217:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809188864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (2660us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.961223:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783135598.961236:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783135598.961241:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809189248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135598.961250:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135598.961281:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809189248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.961287:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1783135598.961310:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135598.961489:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809188992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135598.961522:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135598.961550:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809189504:0@lo:400:kworker.0 00000100:00100000:0.0:1783135598.961575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135598.961601:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809190016:0@lo:400:kworker.0 00000100:00100000:0.0:1783135598.961622:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135598.961636:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809190528:0@lo:400:kworker.0 00000100:00100000:0.0:1783135598.961655:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135598.961674:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1783135598.961679:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809189120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135598.961702:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135598.961720:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809189632:0@lo:400:kworker.0 00000100:00100000:0.0:1783135598.961739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135598.961754:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809190144:0@lo:400:kworker.0 00000100:00100000:0.0:1783135598.961773:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135598.961787:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809190656:0@lo:400:kworker.0 00000100:00100000:0.0:1783135598.961805:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135598.961830:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809190784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135598.961852:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135598.961884:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809189120 00000100:00100000:0.0:1783135598.961895:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809189120 00000100:00100000:0.0:1783135598.961920:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809189632 00000100:00100000:0.0:1783135598.961923:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809189632 00000100:00100000:0.0:1783135598.961936:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1783135598.961943:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809189120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135598.961972:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1783135598.962015:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809189120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135598.962021:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1783135598.962035:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1783135598.962042:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809189632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135598.962068:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809189632:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135598.962074:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1783135598.962131:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809189120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135598.962141:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809189632:0@lo:400:kworker.0 00000100:00100000:3.0:1783135598.962214:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809189504 00000100:00100000:3.0:1783135598.962219:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809189504 00000100:00100000:3.0:1783135598.962238:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809190016 00000100:00100000:3.0:1783135598.962240:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809190016 00000100:00100000:3.0:1783135598.962265:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809190528 00000100:00100000:3.0:1783135598.962268:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809190528 00000100:00100000:3.0:1783135598.962281:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809190144 00000100:00100000:3.0:1783135598.962283:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809190144 00000100:00100000:3.0:1783135598.962296:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809190656 00000100:00100000:3.0:1783135598.962298:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809190656 00000100:00100000:3.0:1783135598.962314:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1783135598.962320:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809189504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135598.962368:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809189504:12345-0@lo:400:kworker.0 Request processed in 48us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.962375:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1783135598.962388:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1783135598.962394:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809190016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135598.962420:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809190016:12345-0@lo:400:kworker.0 Request processed in 26us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.962426:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1783135598.962438:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1783135598.962443:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809190528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135598.962467:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809190528:12345-0@lo:400:kworker.0 Request processed in 24us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.962482:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1783135598.962494:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1783135598.962500:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809190144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135598.962528:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809190144:12345-0@lo:400:kworker.0 Request processed in 28us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.962534:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1783135598.962545:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1783135598.962550:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809190656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135598.962575:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809190656:12345-0@lo:400:kworker.0 Request processed in 24us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.962580:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1783135598.962596:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809188992 00000100:00100000:3.0:1783135598.962600:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809188992 00000100:00100000:3.0:1783135598.962613:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809190784 00000100:00100000:3.0:1783135598.962615:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809190784 00000100:00100000:3.0:1783135598.962626:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783135598.962632:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809188992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135598.962647:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783135598.962674:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809188992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.962679:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1783135598.962690:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783135598.962696:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809190784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135598.962709:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783135598.962736:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809190784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135598.962747:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783135598.962773:0:3649:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1783135598.962779:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1783135598.962797:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac544174e00, transno 4294967308 00000004:00080000:1.0:1783135598.962813:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1783135598.962822:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac67f885180, transno 4294967311 00000100:00100000:1.0:1783135598.962831:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543961500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809189248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135598.962848:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809188864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135598.963478:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809190784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783135598.963581:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135598.963585:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783135598.963614:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54379d180 x1869752809190144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135598.963627:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809190144:0@lo:400:kworker.0 00010000:00080000:0.0:1783135598.963646:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54379c000 x1869752809190656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135598.963654:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809190656:0@lo:400:kworker.0 00000100:00100000:0.0:1783135598.963691:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809188992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135598.963703:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809189504:0@lo:400:kworker.0 00000100:00100000:0.0:1783135598.963713:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809190016:0@lo:400:kworker.0 00000100:00100000:0.0:1783135598.963724:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809190528:0@lo:400:kworker.0 00010000:00010000:2.0:1783135599.477488:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135600.494450:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135601.521240:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783135602.035651:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:1.0:1783135602.035666:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000100:00100000:0.0:1783135602.037008:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809190912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135602.037118:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135602.037281:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809190912 00000100:00100000:1.0:1783135602.037290:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809190912 00000100:00100000:1.0:1783135602.037351:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1783135602.037372:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809190912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135602.037408:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135602.038316:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809190912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 953us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135602.038328:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000001:00080000:1.0:1783135602.039932:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1783135602.039973:0:6501:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ac5439873c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1783135602.039979:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac648b81900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ac5439879c0 00000020:00080000:1.0:1783135602.039996:0:6501:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8ac648b81000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ac67f8ffe00 00000020:00080000:1.0:1783135602.040027:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1783135602.040121:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1783135602.040206:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1783135602.040223:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135602.040235:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135602.040243:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135602.040250:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8e00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135602.040256:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135602.040263:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135602.040295:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ac65800c400) 00010000:00010000:3.0:1783135602.040307:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135602.040313:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135602.040319:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8e00/0xf7de4ef628ee09d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135602.040613:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809190912:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1783135602.543402:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135603.257042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135603.257078:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135603.257119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135603.257136:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135603.257150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135603.257164:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135603.257180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135603.257203:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786073984 00000100:00100000:1.0:1783135603.257212:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786073984 00000100:00100000:1.0:1783135603.257267:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 403 00000100:00100000:1.0:1783135603.257276:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752786073984:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135603.257337:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2398:x1869752786073984:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 64us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135603.257344:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 403 00000100:00100000:1.0:1783135603.257375:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786074240 00000100:00100000:1.0:1783135603.257378:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786074240 00000100:00100000:1.0:1783135603.257408:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786074752 00000100:00100000:1.0:1783135603.257410:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786074752 00000100:00100000:1.0:1783135603.257421:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786074112 00000100:00100000:1.0:1783135603.257423:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786074112 00000100:00100000:1.0:1783135603.257431:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786074624 00000100:00100000:1.0:1783135603.257433:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786074624 00000100:00100000:1.0:1783135603.257444:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 386 00000100:00100000:1.0:1783135603.257450:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752786074240:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135603.257476:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752786074240:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135603.257496:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 386 00000100:00100000:1.0:1783135603.257509:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 387 00000100:00100000:1.0:1783135603.257515:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752786074752:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135603.257536:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752786074752:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 22us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135603.257541:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 387 00000100:00100000:1.0:1783135603.257550:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 388 00000100:00100000:1.0:1783135603.257555:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:2398:x1869752786074112:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135603.257575:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:2398:x1869752786074112:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 20us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135603.257580:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 388 00000100:00100000:1.0:1783135603.257589:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 389 00000100:00100000:1.0:1783135603.257594:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752786074624:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135603.257609:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2398:x1869752786074624:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 15us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135603.257614:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 389 00000100:00100000:1.0:1783135603.257628:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786074496 00000100:00100000:1.0:1783135603.257631:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786074496 00000100:00100000:1.0:1783135603.257653:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786074368 00000100:00100000:1.0:1783135603.257656:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786074368 00000100:00100000:1.0:1783135603.257674:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 111 00000100:00100000:1.0:1783135603.257681:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752786074496:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135603.257703:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2398:x1869752786074496:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135603.257719:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 111 00000100:00100000:1.0:1783135603.257730:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:1.0:1783135603.257736:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2398:x1869752786074368:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135603.257760:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2398:x1869752786074368:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135603.257766:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00080000:1.0:1783135603.257905:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135603.257911:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135603.257914:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135603.257916:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783135603.567637:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135603.636147:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135603.636320:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786074880 00000100:00100000:3.0:1783135603.636341:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786074880 00000100:00100000:3.0:1783135603.636448:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 255 00000100:00100000:3.0:1783135603.636461:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:12163:x1869752786074880:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783135603.636663:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:12163:x1869752786074880:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 Request processed in 204us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135603.636673:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 255 00000100:00100000:1.0:1783135603.646894:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135603.647162:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786075008 00000100:00100000:2.0:1783135603.647177:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786075008 00000100:00100000:2.0:1783135603.647267:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 256 00000100:00100000:2.0:1783135603.647290:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:12163:x1869752786075008:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783135603.649179:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:12163:x1869752786075008:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 Request processed in 1876us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135603.649197:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 256 00000100:00100000:0.0:1783135603.652551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135603.655542:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786075264 00000100:00100000:2.0:1783135603.655564:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786075264 00000100:00100000:2.0:1783135603.655668:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:2.0:1783135603.655682:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:12163:x1869752786075264:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783135603.656033:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:12163:x1869752786075264:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 353us (3494us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1783135603.656062:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:0.0:1783135604.078586:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809191040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135604.078694:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135604.078842:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809191040 00000100:00100000:0.0:1783135604.078851:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809191040 00000100:00100000:0.0:1783135604.078922:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783135604.078938:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809191040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135604.078978:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1783135604.079139:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135604.079166:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809191168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135604.079208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135604.079258:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809191168 00000100:00100000:1.0:1783135604.079263:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809191168 00000100:00100000:1.0:1783135604.079297:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783135604.079303:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809191168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783135604.079334:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783135604.079386:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809191168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135604.079393:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783135604.079446:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543963b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809191168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135604.079582:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809191040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 649us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135604.079589:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783135604.080112:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809191680:0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080152:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135604.080195:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809192192:0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135604.080269:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809192704:0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135604.080318:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1783135604.080324:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809191552:0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080347:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135604.080361:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809192064:0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080382:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135604.080401:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809192576:0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080422:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135604.080451:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809191680 00000100:00100000:0.0:1783135604.080457:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809191680 00000100:00100000:0.0:1783135604.080496:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809191552 00000100:00100000:0.0:1783135604.080500:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809191552 00000100:00100000:0.0:1783135604.080513:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809192064 00000100:00100000:0.0:1783135604.080516:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809192064 00000100:00100000:0.0:1783135604.080539:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809192576 00000100:00100000:0.0:1783135604.080542:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809192576 00000100:00100000:0.0:1783135604.080561:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1783135604.080568:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809191680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080619:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809191680:12345-0@lo:400:kworker.0 Request processed in 51us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135604.080627:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1783135604.080641:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1783135604.080646:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809191552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080670:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809191552:12345-0@lo:400:kworker.0 Request processed in 24us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135604.080676:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1783135604.080696:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1783135604.080702:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809192064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080731:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1869752809192064:12345-0@lo:400:kworker.0 Request processed in 30us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135604.080738:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1783135604.080749:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1783135604.080755:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809192576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080780:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1869752809192576:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135604.080786:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00080000:0.0:1783135604.080801:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135604.080836:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809191552:0@lo:400:kworker.0 00010000:00080000:0.0:1783135604.080850:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac542799c00 x1869752809192064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135604.080861:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1869752809192064:0@lo:400:kworker.0 00010000:00080000:0.0:1783135604.080870:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54279b480 x1869752809192576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135604.080877:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809192576:0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.080885:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809191680:0@lo:400:kworker.0 00000100:00100000:1.0:1783135604.082634:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809192192 00000100:00100000:1.0:1783135604.082675:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809192192 00000100:00100000:1.0:1783135604.082759:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809192704 00000100:00100000:1.0:1783135604.082763:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809192704 00000100:00100000:1.0:1783135604.082798:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783135604.082810:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809192192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135604.082909:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809192192:12345-0@lo:400:kworker.0 Request processed in 101us (2686us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135604.082916:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783135604.082935:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783135604.082941:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809192704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135604.082971:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809192704:12345-0@lo:400:kworker.0 Request processed in 30us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135604.082977:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1783135604.083056:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809191040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135604.083860:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809191296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135604.083922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135604.083972:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809191808:0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084015:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135604.084039:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809192320:0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084065:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135604.084109:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809192832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135604.084133:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135604.084162:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1783135604.084170:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809191424:0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135604.084240:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809191936:0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084269:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135604.084287:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809192448:0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084308:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135604.084323:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809192960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135604.084343:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135604.084380:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809191808 00000100:00100000:2.0:1783135604.084386:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809191808 00000100:00100000:2.0:1783135604.084438:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783135604.084447:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809191808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084501:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809191808:12345-0@lo:400:kworker.0 Request processed in 55us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135604.084528:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783135604.084577:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809191936 00000100:00100000:2.0:1783135604.084582:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809191936 00000100:00100000:2.0:1783135604.084611:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809192448 00000100:00100000:2.0:1783135604.084614:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809192448 00000100:00100000:2.0:1783135604.084634:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1783135604.084641:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809191936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084673:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809191936:12345-0@lo:400:kworker.0 Request processed in 33us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135604.084679:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1783135604.084691:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1783135604.084696:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809192448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084718:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809192448:12345-0@lo:400:kworker.0 Request processed in 22us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135604.084724:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1783135604.084739:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809192320 00000100:00100000:2.0:1783135604.084743:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809192320 00000100:00100000:2.0:1783135604.084772:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783135604.084778:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809192320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084809:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809192320:12345-0@lo:400:kworker.0 Request processed in 31us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135604.084815:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783135604.084857:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809191936:0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084869:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809192448:0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084879:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809191808:0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.084897:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1783135604.084904:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:2.0:1783135604.084926:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809192320:0@lo:400:kworker.0 00000100:00100000:3.0:1783135604.085048:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809191296 00000100:00100000:3.0:1783135604.085054:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809191296 00000100:00100000:3.0:1783135604.085078:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809192832 00000100:00100000:3.0:1783135604.085080:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809192832 00000100:00100000:3.0:1783135604.085132:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809192960 00000100:00100000:3.0:1783135604.085135:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809192960 00000100:00100000:3.0:1783135604.085146:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783135604.085153:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809191296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135604.085179:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783135604.085218:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809191296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135604.085224:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783135604.085250:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783135604.085256:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809192832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135604.085266:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135604.085294:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809192832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135604.085300:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783135604.085310:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783135604.085315:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809192960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135604.085325:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1783135604.085346:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809192960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135604.085363:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1783135604.087676:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135604.087776:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809191424 00000100:00100000:0.0:1783135604.087792:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809191424 00000100:00100000:0.0:1783135604.087893:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1783135604.087907:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809191424:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783135604.088334:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135604.088338:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135604.088405:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809192192:0@lo:400:kworker.0 00000100:00100000:1.0:1783135604.088429:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809192704:0@lo:400:kworker.0 00000100:00100000:0.0:1783135604.089324:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809191424:12345-0@lo:400:kworker.0 Request processed in 1415us (5112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135604.089422:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1783135604.090477:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809191424:0@lo:400:kworker.0 00000100:00100000:2.0:1783135604.090518:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809192960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135604.090539:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809191296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135604.090556:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809192832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135604.134377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135604.134721:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786075392 00000100:00100000:2.0:1783135604.134734:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786075392 00000100:00100000:2.0:1783135604.134824:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 257 00000100:00100000:2.0:1783135604.134837:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54379e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:12958:x1869752786075392:12345-192.168.204.6@tcp:101:lsof.0 00010000:00010000:2.0:1783135604.134866:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135604.134912:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0a63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140fc3 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135604.135333:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee0a6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135604.135353:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee0a6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135604.135368:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee0a6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135604.135439:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135604.135444:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135604.135492:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee0a6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135604.136411:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909e00/0xf7de4ef628ee0a63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fc3 expref: 7 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135604.136445:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee0a6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fc3 expref: 6 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135604.136455:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:2.0:1783135604.136459:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135604.136464:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909600, rc 0) 00000100:00100000:2.0:1783135604.137301:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54379e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:12958:x1869752786075392:12345-192.168.204.6@tcp:101:lsof.0 Request processed in 2457us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135604.137313:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 257 00010000:00010000:3.0:1783135604.591012:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135605.614339:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135606.639991:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135607.152423:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135607.152451:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809193088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135607.152534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135607.152812:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809193088 00000100:00100000:1.0:1783135607.152821:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809193088 00000100:00100000:1.0:1783135607.152887:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1783135607.152896:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809193088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135607.152931:0:13344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135607.153007:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809193088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135607.153014:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1783135607.153245:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809193088:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135607.662408:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135608.152914:0:14872:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:26:47 (1783135607) 00000040:00080000:3.0:1783135608.174792:0:13815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135608.174805:0:13815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135608.174930:0:13815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1783135608.174938:0:13815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1783135608.177414:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1783135608.177435:0:6501:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1783135608.177783:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1783135608.177808:0:6554:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1783135608.377997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135608.378044:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135608.378068:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135608.378084:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135608.378126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135608.378142:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135608.378177:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135608.378203:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786075776 00000100:00100000:0.0:1783135608.378211:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786075776 00000100:00100000:0.0:1783135608.378261:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786076288 00000100:00100000:0.0:1783135608.378264:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786076288 00000100:00100000:0.0:1783135608.378275:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786075648 00000100:00100000:0.0:1783135608.378277:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786075648 00000100:00100000:0.0:1783135608.378287:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786076160 00000100:00100000:0.0:1783135608.378289:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786076160 00000100:00100000:0.0:1783135608.378302:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 396 00000100:00100000:0.0:1783135608.378311:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786075776:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135608.378387:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786075776:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135608.378395:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 396 00000100:00100000:0.0:1783135608.378412:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 397 00000100:00100000:0.0:1783135608.378418:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786076288:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135608.378438:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2400:x1869752786076288:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 21us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135608.378457:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 397 00000100:00100000:0.0:1783135608.378467:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 398 00000100:00100000:0.0:1783135608.378473:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:2400:x1869752786075648:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135608.378499:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:2400:x1869752786075648:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135608.378505:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 398 00000100:00100000:0.0:1783135608.378513:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 399 00000100:00100000:0.0:1783135608.378518:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752786076160:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135608.378535:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2400:x1869752786076160:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 17us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135608.378540:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 399 00000100:00100000:0.0:1783135608.378555:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786076032 00000100:00100000:0.0:1783135608.378558:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786076032 00000100:00100000:0.0:1783135608.378580:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786075904 00000100:00100000:0.0:1783135608.378582:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786075904 00000100:00100000:0.0:1783135608.378597:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 116 00000100:00100000:0.0:1783135608.378602:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786076032:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135608.378623:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2400:x1869752786076032:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 21us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135608.378628:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 116 00000100:00100000:0.0:1783135608.378638:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00100000:0.0:1783135608.378643:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786075904:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135608.378661:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2400:x1869752786075904:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 19us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135608.378686:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00080000:0.0:1783135608.378716:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135608.378721:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135608.378724:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135608.378726:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135608.381800:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786075520 00000100:00100000:3.0:1783135608.381817:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786075520 00000100:00100000:3.0:1783135608.381898:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 405 00000100:00100000:3.0:1783135608.381909:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752786075520:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1783135608.382020:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752786075520:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 112us (4028us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135608.382027:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 405 00000040:00080000:1.0:1783135608.562817:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783135608.686312:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135609.198709:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135609.198743:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809193216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135609.198846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135609.198937:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809193216 00000100:00100000:1.0:1783135609.198947:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809193216 00000100:00100000:1.0:1783135609.199014:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783135609.199024:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809193216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783135609.199074:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1783135609.199174:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809193216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135609.199183:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783135609.199249:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809193216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135609.199533:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809193344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135609.199573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135609.201996:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809193600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135609.202083:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135609.202196:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809193344 00000100:00100000:1.0:1783135609.202206:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809193344 00000100:00100000:1.0:1783135609.202268:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809193600 00000100:00100000:1.0:1783135609.202272:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809193600 00000100:00100000:1.0:1783135609.202296:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783135609.202307:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809193344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135609.202346:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783135609.202405:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809193344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135609.202414:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1783135609.202435:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783135609.202442:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809193600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135609.202455:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783135609.202484:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809193600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135609.202491:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1783135609.202510:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135609.202554:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809193600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135609.206495:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809193728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135609.206609:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135609.206701:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809193728 00000100:00100000:3.0:1783135609.206710:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809193728 00000100:00100000:3.0:1783135609.206798:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783135609.206810:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809193728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135609.206852:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1783135609.206906:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809193728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135609.206933:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783135609.207064:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809194112:0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.207122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135609.207158:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809194624:0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.207182:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135609.207209:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783135609.207216:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809194240:0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.207245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135609.207266:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809194752:0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.207289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783135609.207322:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135609.207340:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809194112 00000100:00100000:3.0:1783135609.207345:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809194112 00000100:00100000:3.0:1783135609.207381:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809194624 00000100:00100000:3.0:1783135609.207385:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809194624 00000100:00100000:3.0:1783135609.207417:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809194752 00000100:00100000:3.0:1783135609.207420:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809194752 00000100:00100000:3.0:1783135609.207442:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1783135609.207449:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809194112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.207494:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809194112:12345-0@lo:400:kworker.0 Request processed in 44us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135609.207501:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1783135609.207517:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1783135609.207523:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809194624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.207551:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809194624:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135609.207568:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1783135609.207581:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1783135609.207587:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809194752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.207616:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809194752:12345-0@lo:400:kworker.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135609.207623:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1783135609.207648:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809194240 00000100:00100000:3.0:1783135609.207652:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809194240 00000100:00100000:3.0:1783135609.207678:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1783135609.207685:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809194240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.207716:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809194240:12345-0@lo:400:kworker.0 Request processed in 32us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135609.207723:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1783135609.207754:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135609.207757:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135609.207794:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809193728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135609.207827:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809194240:0@lo:400:kworker.0 00010000:00080000:3.0:1783135609.207839:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54279b800 x1869752809194752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135609.207850:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809194752:0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.207860:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809194112:0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.207868:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809194624:0@lo:400:kworker.0 00000100:00100000:2.0:1783135609.208020:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809193856:0@lo:400:kworker.0 00000100:00100000:2.0:1783135609.208060:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135609.208105:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809194368:0@lo:400:kworker.0 00000100:00100000:2.0:1783135609.208141:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135609.208156:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809194880:0@lo:400:kworker.0 00000100:00100000:2.0:1783135609.208183:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135609.208218:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809193344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135609.208244:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1783135609.208252:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809193472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135609.208277:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135609.208293:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809193984:0@lo:400:kworker.0 00000100:00100000:2.0:1783135609.208316:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135609.208329:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809194496:0@lo:400:kworker.0 00000100:00100000:2.0:1783135609.208349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135609.208374:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809193856 00000100:00100000:2.0:1783135609.208378:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809193856 00000100:00100000:2.0:1783135609.208409:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1783135609.208415:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809193856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135609.208451:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809193856:12345-0@lo:400:kworker.0 Request processed in 37us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135609.208457:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1783135609.208490:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809194880 00000100:00100000:2.0:1783135609.208494:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809194880 00000100:00100000:2.0:1783135609.208529:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783135609.208535:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809194880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135609.208565:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809194880:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135609.208570:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783135609.208596:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809193856:0@lo:400:kworker.0 00000100:00100000:2.0:1783135609.208606:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809194880:0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.208751:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809194368 00000100:00100000:3.0:1783135609.208763:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809194368 00000100:00100000:3.0:1783135609.208791:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809193984 00000100:00100000:3.0:1783135609.208795:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809193984 00000100:00100000:3.0:1783135609.208812:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809194496 00000100:00100000:3.0:1783135609.208814:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809194496 00000100:00100000:3.0:1783135609.208829:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1783135609.208835:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809194368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.208876:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809194368:12345-0@lo:400:kworker.0 Request processed in 41us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135609.208882:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1783135609.208894:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1783135609.208900:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809193984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.208943:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809193984:12345-0@lo:400:kworker.0 Request processed in 43us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135609.208949:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1783135609.208960:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1783135609.208966:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809194496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135609.208993:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809194496:12345-0@lo:400:kworker.0 Request processed in 28us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135609.208999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00080000:3.0:1783135609.209021:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783135609.209025:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135609.209027:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135609.212553:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809193472 00000100:00100000:2.0:1783135609.212576:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809193472 00000100:00100000:2.0:1783135609.212693:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783135609.212705:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809193472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135609.212743:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135609.212854:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809193472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 151us (4575us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135609.212863:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783135609.212968:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809193472:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135609.212987:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809193984:0@lo:400:kworker.0 00010000:00080000:2.0:1783135609.213005:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54279b100 x1869752809194496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135609.213017:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809194496:0@lo:400:kworker.0 00000100:00100000:2.0:1783135609.213032:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809194368:0@lo:400:kworker.0 00010000:00010000:2.0:1783135609.711422:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135610.735344:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135611.758920:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135612.271971:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135612.271999:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809195008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135612.272118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135612.272473:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809195008 00000100:00100000:1.0:1783135612.272483:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809195008 00000100:00100000:1.0:1783135612.272549:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783135612.272562:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809195008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135612.272602:0:13344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1783135612.272673:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809195008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135612.272682:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1783135612.272901:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809195008:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135612.783174:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135613.137773:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135613.137959:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786076544 00000100:00100000:3.0:1783135613.137970:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786076544 00000100:00100000:3.0:1783135613.138303:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:3.0:1783135613.138316:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:13182:x1869752786076544:12345-192.168.204.6@tcp:35:umount.0 00000100:00100000:3.0:1783135613.138600:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:13182:x1869752786076544:12345-192.168.204.6@tcp:35:umount.0 Request processed in 285us (836us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1783135613.138609:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00080000:1.0:1783135613.139982:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135613.143533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135613.152038:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786076800 00000100:00100000:1.0:1783135613.152055:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786076800 00000100:00100000:1.0:1783135613.152188:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:1.0:1783135613.152200:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+19:13182:x1869752786076800:12345-192.168.204.6@tcp:35:umount.0 00000100:00100000:1.0:1783135613.152790:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:13182:x1869752786076800:12345-192.168.204.6@tcp:35:umount.0 Request processed in 591us (9266us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1783135613.152815:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:0.0:1783135613.156262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135613.156323:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786077056 00000100:00100000:3.0:1783135613.156334:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786077056 00000100:00100000:3.0:1783135613.156398:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:3.0:1783135613.156408:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac660a8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+20:13182:x1869752786077056:12345-192.168.204.6@tcp:35:umount.0 00000100:00100000:3.0:1783135613.156954:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac660a8e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:13182:x1869752786077056:12345-192.168.204.6@tcp:35:umount.0 Request processed in 536us (690us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1783135613.156963:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:0.0:1783135613.164319:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135613.164428:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786077312 00000100:00100000:1.0:1783135613.164440:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786077312 00000100:00100000:1.0:1783135613.164599:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:1.0:1783135613.164612:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+21:13182:x1869752786077312:12345-192.168.204.6@tcp:35:umount.0 00000100:00100000:1.0:1783135613.165055:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:13182:x1869752786077312:12345-192.168.204.6@tcp:35:umount.0 Request processed in 445us (743us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1783135613.165073:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:0.0:1783135613.174300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135613.174564:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135613.174878:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786077696 00000100:00100000:1.0:1783135613.174888:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786077696 00000100:00100000:0.0:1783135613.174888:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135613.175023:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786077568 00000100:00100000:2.0:1783135613.175028:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786077568 00000100:00100000:2.0:1783135613.175067:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786077824 00000100:00100000:2.0:1783135613.175071:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786077824 00000100:00100000:0.0:1783135613.175130:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135613.175155:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786077440 00000100:00100000:0.0:1783135613.175159:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786077440 00000100:00100000:0.0:1783135613.175201:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:0.0:1783135613.175212:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2397:x1869752786077440:12345-192.168.204.6@tcp:9:umount.0 00000020:00000080:0.0:1783135613.175245:0:8620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edfd5f 00000100:00080000:0.0:1783135613.175255:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8ac543a8b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135613.175302:0:8620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1783135613.175439:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:2.0:1783135613.175447:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+15:2400:x1869752786077696:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135613.175475:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135613.175493:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65d000/0xf7de4ef628edf984 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ad7 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135613.175544:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+2:2397:x1869752786077440:12345-192.168.204.6@tcp:9:umount.0 Request processed in 333us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135613.175552:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 81 00010000:00010000:2.0:1783135613.175574:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135613.175575:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135613.175594:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+14:2400:x1869752786077696:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 148us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135613.175601:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:2.0:1783135613.176259:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:2.0:1783135613.176277:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+13:2400:x1869752786077568:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135613.176287:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135613.176298:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20fa00/0xf7de4ef628edfa41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b16 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.176309:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135613.176345:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:2400:x1869752786077568:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 75us (1782us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135613.176470:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:3.0:1783135613.176481:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:2400:x1869752786077824:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135613.176489:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135613.176499:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650988200/0xf7de4ef628edfc94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bef expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135613.176590:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00010000:00010000:3.0:1783135613.178148:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1783135613.178438:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135613.180048:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2400:x1869752786077824:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 3559us (5149us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135613.180071:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:0.0:1783135613.186129:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135613.186236:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786078208 00000100:00100000:2.0:1783135613.186246:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786078208 00000100:00100000:2.0:1783135613.186321:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:2.0:1783135613.186332:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+7:2397:x1869752786078208:12345-192.168.204.6@tcp:9:umount.0 00000020:00000080:2.0:1783135613.186367:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edffd5 00000020:00010000:2.0:1783135613.186389:0:8435:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ac65077e800: total 0 00000100:00080000:2.0:1783135613.186393:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8ac65077a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783135613.186452:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000020:00010000:3.0:1783135613.186703:0:8453:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ac65077e800: total 0 00010000:00010000:3.0:1783135613.186746:0:8453:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ac65077e800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1783135613.186803:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0a5c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fbc expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135613.186840:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000231d557a/0xf7de4ef628ee038d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dd9 expref: 6 pid: 8620 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135613.186869:0:8453:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ac65077e800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1783135613.186882:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135613.186884:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135613.186885:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135613.187018:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+2:2397:x1869752786078208:12345-192.168.204.6@tcp:9:umount.0 Request processed in 688us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135613.187027:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00080000:1.0:1783135613.187347:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135613.202601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135613.202692:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786079232 00000100:00100000:3.0:1783135613.202703:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786079232 00000100:00100000:3.0:1783135613.202771:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 258 00000100:00100000:3.0:1783135613.202781:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+22:2397:x1869752786079232:12345-192.168.204.6@tcp:39:umount.0 00000020:00000080:3.0:1783135613.202820:0:6524:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf999 00000020:00010000:3.0:1783135613.202837:0:6524:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ac67c6fd000: total 0 00000100:00080000:3.0:1783135613.202842:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6fc000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135613.202878:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:2.0:1783135613.202905:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ac67c6fd000: total 0 00010000:00010000:2.0:1783135613.202965:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ac67c6fd000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1783135613.202997:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:2.0:1783135613.203002:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135613.203010:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b800/0xf7de4ef628ee03f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140df5 expref: 23 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203031:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135613.203033:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783135613.203037:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527e00/0xf7de4ef628edfd35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c19 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203048:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:2.0:1783135613.203050:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135613.203053:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c51b000/0xf7de4ef628ee034e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dc4 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135613.203072:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+18:2397:x1869752786079232:12345-192.168.204.6@tcp:39:umount.0 Request processed in 292us (483us total) trans 4294967528 rc 0/0 00010000:00010000:2.0:1783135613.203077:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:2.0:1783135613.203079:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:3.0:1783135613.203080:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 258 00010000:00010000:2.0:1783135613.203083:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e8a00/0xf7de4ef628ee06ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140ed5 expref: 18 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203144:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ac5424cda00) 00010000:00010000:2.0:1783135613.203158:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135613.203162:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee0030 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140cf2 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203183:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac672e7af00) 00010000:00010000:2.0:1783135613.203185:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135613.203188:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628edfcda lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140c04 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203201:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135613.203203:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135613.203206:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac6413e9a00/0xf7de4ef628ee093d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140f6f expref: 14 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203217:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:2.0:1783135613.203220:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783135613.203223:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908600/0xf7de4ef628ee0378 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dd2 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203233:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ac67c558e00) 00010000:00010000:2.0:1783135613.203235:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135613.203239:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee026e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140d8c expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203253:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ac65800c700) 00010000:00010000:2.0:1783135613.203256:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783135613.203259:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac640031200/0xf7de4ef628ee0412 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140dfc expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203290:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135613.203292:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783135613.203296:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac682172800/0xf7de4ef628ee0a47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fb5 expref: 10 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203307:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ac672e7a000) 00010000:00010000:2.0:1783135613.203309:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135613.203312:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20ee00/0xf7de4ef628edfcbe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140bfd expref: 9 pid: 13464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203324:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ac65800cc00) 00010000:00010000:2.0:1783135613.203326:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135613.203329:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908c00/0xf7de4ef628ee0a1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fa7 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135613.203341:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ac67c6fd000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1783135613.203355:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135613.203371:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135613.203373:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783135613.211694:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000001:00080000:0.0:1783135613.211715:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1783135613.211750:0:6501:0:(genops.c:906:class_export_put()) final put ffff8ac67c6fd000/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000020:00000080:3.0:1783135613.211974:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c6fd000/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe for lustre-MDT0000 00000020:00000080:3.0:1783135613.216064:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c6fc000 for lustre-MDT0000 00000100:00100000:0.0:1783135613.230998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135613.231288:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786079360 00000100:00100000:3.0:1783135613.231300:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786079360 00000100:00100000:3.0:1783135613.231432:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 259 00000100:00100000:3.0:1783135613.231446:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+5:2397:x1869752786079360:12345-192.168.204.6@tcp:39:umount.0 00000020:00000080:3.0:1783135613.231481:0:6522:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf992 00000100:00080000:3.0:1783135613.231512:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8ac543928800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135613.231540:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1783135613.231722:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:393908cf-d54e-4d7c-b6e6-bcde2fa6fefe+3:2397:x1869752786079360:12345-192.168.204.6@tcp:39:umount.0 Request processed in 279us (734us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783135613.231745:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 259 00010000:00010000:0.0:1783135613.233795:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135613.236376:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135613.494247:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135613.494292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135613.494446:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786079616 00000100:00100000:2.0:1783135613.494457:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786079616 00000100:00100000:2.0:1783135613.494541:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786079488 00000100:00100000:2.0:1783135613.494545:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786079488 00000100:00100000:2.0:1783135613.494570:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 406 00000100:00100000:2.0:1783135613.494578:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752786079616:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135613.494654:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2401:x1869752786079616:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 76us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135613.494682:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 406 00000100:00100000:2.0:1783135613.494701:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 407 00000100:00100000:2.0:1783135613.494707:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2401:x1869752786079488:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135613.494735:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2401:x1869752786079488:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135613.494740:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 407 00000100:00080000:1.0:1783135613.494804:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135613.494807:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1783135613.807174:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135614.318419:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809195136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135614.318503:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135614.318617:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135614.318624:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809195264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135614.318651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135614.318683:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809195136 00000100:00100000:2.0:1783135614.318690:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809195136 00000100:00100000:2.0:1783135614.318738:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809195264 00000100:00100000:2.0:1783135614.318742:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809195264 00000100:00100000:2.0:1783135614.318765:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783135614.318773:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809195136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135614.318808:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1783135614.318810:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135614.318819:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809195392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135614.318850:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135614.318852:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809195136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135614.318859:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783135614.318876:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783135614.318882:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809195264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135614.318893:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1783135614.318917:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809195264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135614.318938:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783135614.318982:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809195264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135614.318997:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809195136:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783135614.319137:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135614.319255:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135614.319265:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809195520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135614.319290:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135614.319375:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809195520 00000100:00100000:1.0:1783135614.319380:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809195520 00000100:00100000:1.0:1783135614.319426:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783135614.319433:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809195520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135614.319452:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135614.319487:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809195520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135614.319493:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783135614.319524:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809195520:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1783135614.319626:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135614.322460:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809195392 00000100:00100000:3.0:1783135614.322474:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809195392 00000100:00100000:3.0:1783135614.322556:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783135614.322566:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809195392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135614.322607:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1783135614.322727:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809195392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (3874us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135614.322736:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1783135614.322907:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135614.322922:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809195648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135614.322967:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135614.323049:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809195392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135614.323112:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809195648 00000100:00100000:1.0:1783135614.323130:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809195648 00000100:00100000:1.0:1783135614.323174:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783135614.323181:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809195648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135614.323197:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1783135614.323231:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809195648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135614.323237:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783135614.325532:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809195648:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783135614.325580:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135614.326242:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809196160:0@lo:400:kworker.0 00000100:00100000:2.0:1783135614.326316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135614.326369:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809196672:0@lo:400:kworker.0 00000100:00100000:2.0:1783135614.326394:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135614.326420:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783135614.326426:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809195776:0@lo:400:kworker.0 00000100:00100000:0.0:1783135614.326580:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809196160 00000100:00100000:0.0:1783135614.326588:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809196160 00000100:00100000:0.0:1783135614.326632:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1783135614.326642:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809196160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135614.326697:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809196160:12345-0@lo:400:kworker.0 Request processed in 56us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135614.326704:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1783135614.326739:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809196672 00000100:00100000:0.0:1783135614.326743:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809196672 00000100:00100000:0.0:1783135614.326776:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1783135614.326783:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809196672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135614.326820:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809196672:12345-0@lo:400:kworker.0 Request processed in 37us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135614.326825:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1783135614.327025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135614.327067:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809196288:0@lo:400:kworker.0 00000100:00100000:2.0:1783135614.327115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135614.327159:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809196160:0@lo:400:kworker.0 00010000:00080000:2.0:1783135614.327173:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438ace00 x1869752809196672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135614.327187:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809196672:0@lo:400:kworker.0 00000100:00100000:2.0:1783135614.327231:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809196288 00000100:00100000:2.0:1783135614.327234:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809196288 00000100:00100000:2.0:1783135614.327262:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1783135614.327268:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809196288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135614.327381:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809195776 00000100:00100000:0.0:1783135614.327385:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809195776 00000100:00100000:0.0:1783135614.327411:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1783135614.327418:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809195776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135614.327472:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809196288:12345-0@lo:400:kworker.0 Request processed in 203us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135614.327479:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1783135614.327560:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809196032:0@lo:400:kworker.0 00000100:00100000:3.0:1783135614.327592:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135614.327611:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809196544:0@lo:400:kworker.0 00000100:00100000:3.0:1783135614.327632:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135614.327650:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783135614.327656:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809195904:0@lo:400:kworker.0 00000100:00100000:3.0:1783135614.327676:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135614.327692:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809196416:0@lo:400:kworker.0 00000100:00100000:3.0:1783135614.327712:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135614.327735:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809196032 00000100:00100000:3.0:1783135614.327744:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809196032 00000100:00100000:3.0:1783135614.327768:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809196544 00000100:00100000:3.0:1783135614.327771:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809196544 00000100:00100000:3.0:1783135614.327784:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809195904 00000100:00100000:3.0:1783135614.327786:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809195904 00000100:00100000:3.0:1783135614.327794:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809196416 00000100:00100000:3.0:1783135614.327796:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809196416 00000100:00100000:3.0:1783135614.327808:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1783135614.327813:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809196032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135614.327848:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809196032:12345-0@lo:400:kworker.0 Request processed in 34us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135614.327854:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1783135614.327868:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1783135614.327873:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809196544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135614.327899:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1869752809196544:12345-0@lo:400:kworker.0 Request processed in 26us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135614.327904:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1783135614.327915:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1783135614.327920:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac54279b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809195904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135614.327945:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac54279b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809195904:12345-0@lo:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135614.327950:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1783135614.327961:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1783135614.327966:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809196416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135614.327988:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809196416:12345-0@lo:400:kworker.0 Request processed in 22us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135614.327994:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1783135614.328050:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809195904:0@lo:400:kworker.0 00010000:00080000:3.0:1783135614.328061:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5438ad180 x1869752809196416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135614.328070:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809196416:0@lo:400:kworker.0 00000100:00100000:3.0:1783135614.328078:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809196032:0@lo:400:kworker.0 00000100:00100000:3.0:1783135614.328109:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1869752809196544:0@lo:400:kworker.0 00000100:00080000:3.0:1783135614.328133:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135614.328136:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135614.342020:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3646:x1869752809195776:12345-0@lo:400:kworker.0 Request processed in 14591us (14984us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135614.342044:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1783135614.342302:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809195776:0@lo:400:kworker.0 00000100:00100000:2.0:1783135614.342324:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809196288:0@lo:400:kworker.0 00010000:00010000:3.0:1783135614.830430:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135615.377889:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135615.377948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135615.377986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135615.378223:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786079744 00000100:00100000:0.0:1783135615.378244:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786079744 00000100:00100000:0.0:1783135615.378353:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786080000 00000100:00100000:0.0:1783135615.378356:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786080000 00000100:00100000:0.0:1783135615.378376:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786079872 00000100:00100000:0.0:1783135615.378379:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786079872 00000100:00100000:0.0:1783135615.378402:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1783135615.378412:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+12:2399:x1869752786079744:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135615.378433:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135615.378462:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65de00/0xf7de4ef628edfa9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b5c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135615.378488:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135615.378580:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+11:2399:x1869752786079744:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 169us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135615.378589:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1783135615.378607:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:0.0:1783135615.378614:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac648bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+10:2400:x1869752786080000:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135615.378621:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135615.378631:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51a600/0xf7de4ef628edfa95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b2b expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135615.378654:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135615.378677:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac648bc6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+9:2400:x1869752786080000:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 63us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135615.378684:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:0.0:1783135615.378731:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:0.0:1783135615.378737:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+8:2399:x1869752786079872:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135615.378765:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135615.378775:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c526a00/0xf7de4ef628edfc8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140be8 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135615.378785:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135615.378806:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f84f745c-c4b5-4c40-8739-179c07c4e2ba+7:2399:x1869752786079872:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 69us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135615.378814:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:1.0:1783135615.402481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135615.402636:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786080256 00000100:00100000:3.0:1783135615.402659:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786080256 00000100:00100000:3.0:1783135615.402756:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 260 00000100:00100000:3.0:1783135615.402768:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+6:2397:x1869752786080256:12345-192.168.204.6@tcp:39:umount.0 00000020:00000080:3.0:1783135615.402849:0:8461:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edfaaa 00000020:00010000:3.0:1783135615.402858:0:8461:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ac67c62c000: total 0 00000100:00080000:3.0:1783135615.402864:0:8461:0:(import.c:65:import_set_state_nolock()) ffff8ac67c62e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135615.402904:0:8461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1783135615.403163:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1783135615.403478:0:6511:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ac67c62c000: total 0 00010000:00010000:1.0:1783135615.403553:0:6511:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ac67c62c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783135615.403613:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac65800c900) 00010000:00010000:1.0:1783135615.403618:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135615.403631:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909600/0xf7de4ef628ee0a6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fc3 expref: 5 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135615.403661:0:6511:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ac67c62c000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1783135615.403675:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135615.403677:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135615.403679:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135615.405152:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+3:2397:x1869752786080256:12345-192.168.204.6@tcp:39:umount.0 Request processed in 2371us (2668us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1783135615.405168:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 260 00000100:00100000:0.0:1783135615.433436:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135615.434170:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786080384 00000100:00100000:3.0:1783135615.434185:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786080384 00000100:00100000:3.0:1783135615.434293:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 261 00000100:00100000:3.0:1783135615.434309:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+5:2397:x1869752786080384:12345-192.168.204.6@tcp:39:umount.0 00000020:00000080:3.0:1783135615.434383:0:6523:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edfab1 00000100:00080000:3.0:1783135615.434413:0:6523:0:(import.c:65:import_set_state_nolock()) ffff8ac67c629800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135615.434454:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:0.0:1783135615.434895:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135615.435234:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40+3:2397:x1869752786080384:12345-192.168.204.6@tcp:39:umount.0 Request processed in 744us (1624us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783135615.435246:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 261 00010000:00010000:2.0:1783135615.438607:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135615.492471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135615.492640:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786080640 00000100:00100000:3.0:1783135615.492654:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786080640 00000100:00100000:3.0:1783135615.492725:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 408 00000100:00100000:3.0:1783135615.492737:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+7:2397:x1869752786080640:12345-192.168.204.6@tcp:251:umount.0 00000020:00000080:3.0:1783135615.492791:0:6516:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf96f 00000020:00010000:3.0:1783135615.492801:0:6516:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ac5439c8000: total 0 00000100:00080000:3.0:1783135615.492806:0:6516:0:(import.c:65:import_set_state_nolock()) ffff8ac5439cd000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783135615.492902:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f84f745c-c4b5-4c40-8739-179c07c4e2ba+3:2397:x1869752786080640:12345-192.168.204.6@tcp:251:umount.0 Request processed in 166us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135615.492912:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 408 00000020:00010000:0.0:1783135615.493082:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ac5439c8000: total 0 00010000:00010000:0.0:1783135615.493139:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135615.493217:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ac5439c8000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783135615.493269:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20ea00/0xf7de4ef628edfa48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140b1d expref: 2 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135615.493288:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ac5439c8000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783135615.493302:0:6510:0:(genops.c:906:class_export_put()) final put ffff8ac5439c8000/f84f745c-c4b5-4c40-8739-179c07c4e2ba 00010000:00010000:0.0:1783135615.493320:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135615.493322:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135615.493324:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783135615.495534:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5439c8000/f84f745c-c4b5-4c40-8739-179c07c4e2ba for MGS 00000020:00000080:3.0:1783135615.495607:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac5439cd000 for MGS 00010000:00010000:3.0:1783135615.854408:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.879221:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135617.396335:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809196800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135617.396475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135617.396660:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809196800 00000100:00100000:0.0:1783135617.396667:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809196800 00000100:00100000:0.0:1783135617.396715:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1783135617.396725:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac542798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809196800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135617.396759:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1783135617.396816:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac542798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809196800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135617.396829:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1783135617.397300:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809196800:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1783135617.832486:0:15068:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783135617.864046:0:15068:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783135617.864157:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.864180:0:15068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.864200:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.864207:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.864748:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783135617.864757:0:15068:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783135617.864787:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135617.864792:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783135617.864817:0:15068:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783135617.864845:0:15068:0:(import.c:65:import_set_state_nolock()) ffff8ac66bed5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783135617.864960:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869752809196928:0@lo:39:umount.0 00000100:00100000:1.0:1783135617.865818:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135617.867410:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135617.867425:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.867438:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c51b600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135617.867442:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.867471:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135617.867479:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135617.867485:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135617.867488:0:8452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783135617.867492:0:8452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783135617.867540:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.867548:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135617.867573:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.867580:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c51b600/0xf7de4ef628edfa17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.867594:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135617.867596:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135617.867598:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135617.867614:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809197056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135617.867679:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135617.867745:0:10344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809197056 00000100:00100000:1.0:1783135617.867753:0:10344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809197056 00000100:00100000:1.0:1783135617.867804:0:10344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135617.867813:0:10344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3648:x1869752809197056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135617.867826:0:10344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135617.867848:0:10344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628edfa1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edfa17 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.867861:0:10344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135617.867896:0:10344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:3648:x1869752809197056:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135617.867905:0:10344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135617.867958:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809197056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135617.868833:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809196928 00000100:00100000:3.0:1783135617.868844:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809196928 00000100:00100000:3.0:1783135617.868907:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783135617.868916:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869752809196928:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783135617.868946:0:6524:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf586 00000100:00080000:3.0:1783135617.868955:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8ac672d67800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783135617.869059:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1869752809196928:12345-0@lo:39:umount.0 Request processed in 144us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135617.869067:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1783135617.869077:0:6524:0:(genops.c:906:class_export_put()) final put ffff8ac658081000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783135617.869124:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac658081000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783135617.869182:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac672d67800 for lustre-MDT0000 00010000:00010000:1.0:1783135617.869305:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135617.869339:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac66bed5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783135617.869358:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869752809196928:0@lo:39:umount.0 00000100:00080000:3.0:1783135617.870122:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135617.870128:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783135617.870140:0:15068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783135617.871324:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871340:0:15068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871347:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871353:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871373:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135617.871389:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135617.871396:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871402:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20fc00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135617.871406:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871413:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135617.871420:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135617.871426:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135617.871429:0:8453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1783135617.871459:0:8453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871480:0:8453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135617.871499:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871506:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fc00/0xf7de4ef628edfa25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa2c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871521:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135617.871523:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135617.871524:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135617.871536:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871543:0:15068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871550:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871556:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871567:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135617.871572:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871579:0:15068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871596:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871602:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871613:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783135617.871619:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871625:0:15068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871631:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871638:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135617.871648:0:15068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1783135617.871651:0:15068:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1783135617.871656:0:15068:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:1.0:1783135617.872435:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809197184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135617.872508:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135617.872573:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783135617.872579:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872587:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989c00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135617.872590:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872599:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135617.872606:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135617.872612:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135617.872624:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783135617.872626:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783135617.872646:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872653:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135617.872686:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872693:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628edf929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf930 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872707:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135617.872710:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872716:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527400 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135617.872719:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872726:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135617.872733:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135617.872738:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783135617.872740:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783135617.872742:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783135617.872754:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872770:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135617.872778:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872784:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c527400/0xf7de4ef628edfc7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfc86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872794:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135617.872797:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872803:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031000 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135617.872808:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872816:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135617.872822:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135617.872826:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135617.872828:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783135617.872830:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783135617.872843:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872848:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135617.872858:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872874:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac640031000/0xf7de4ef628edf4e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf4ec expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.872883:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135617.872885:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135617.872887:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135617.872893:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135617.872899:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135617.872909:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809197312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135617.872937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135617.872963:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135617.872983:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809197440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135617.873601:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809197184 00000100:00100000:0.0:1783135617.873610:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809197184 00000100:00100000:0.0:1783135617.873657:0:10346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809197312 00000100:00100000:0.0:1783135617.873660:0:10346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809197312 00000100:00100000:0.0:1783135617.873702:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783135617.873712:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+24:3649:x1869752809197184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135617.873727:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135617.873744:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527c00/0xf7de4ef628edfa2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edfa25 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135617.873758:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135617.873796:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+23:3649:x1869752809197184:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135617.873803:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783135617.873819:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135617.873825:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:3646:x1869752809197312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135617.873831:0:10346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135617.873839:0:10346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c526200/0xf7de4ef628edf930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf929 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135617.873847:0:10346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135617.873867:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3646:x1869752809197312:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135617.873873:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135617.873918:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809197568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135617.873961:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809197184:0@lo:103:ldlm_bl.0 00000020:01000004:3.0:1783135617.874794:0:15068:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783135617.874800:0:15068:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1783135617.874805:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135617.874813:0:15068:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:3.0:1783135617.874819:0:15068:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ac5430d1800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135617.874826:0:15068:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ac5424b8800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135617.874843:0:15068:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ac646dbe000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135617.874847:0:15068:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8ac67c2e5000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1783135617.874854:0:15068:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8ac67c62c000 eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 192.168.204.6@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135617.874860:0:15068:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8ac672dccd40) has exports, disconnecting them 00000020:00080000:3.0:1783135617.874863:0:15068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ac5430d1800), last request at 1783135614 00000020:00000080:3.0:1783135617.874872:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf896 00000100:00080000:3.0:1783135617.874887:0:15068:0:(import.c:65:import_set_state_nolock()) ffff8ac5430d7800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783135617.874946:0:15068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac5430d1800): rc 0 00000020:00000080:3.0:1783135617.874949:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac5430d1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783135617.874958:0:15068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ac5424b8800), last request at 1783135614 00000020:00000080:3.0:1783135617.874961:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf770 00000100:00080000:3.0:1783135617.874966:0:15068:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bc800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783135617.874994:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5430d1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783135617.875119:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac5430d7800 for lustre-MDT0000 00000020:00080000:3.0:1783135617.875137:0:15068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac5424b8800): rc 0 00000020:00000080:3.0:1783135617.875139:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac5424b8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1783135617.875146:0:15068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ac646dbe000), last request at 1783135347 00000020:00000080:3.0:1783135617.875150:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf66d 00000100:00080000:3.0:1783135617.875154:0:15068:0:(import.c:65:import_set_state_nolock()) ffff8ac67c47b000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783135617.875167:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5424b8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783135617.875193:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac5424bc800 for lustre-MDT0000 00000020:00080000:3.0:1783135617.875204:0:15068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac646dbe000): rc 0 00000020:00000080:3.0:1783135617.875206:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac646dbe000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1783135617.875213:0:15068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ac67c2e5000), last request at 1783135347 00000100:00100000:1.0:1783135617.875496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135617.875570:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809197312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135617.875728:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135617.875739:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135617.875775:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809197440 00000100:00100000:1.0:1783135617.875782:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809197440 00000100:00100000:1.0:1783135617.875864:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809197568 00000100:00100000:1.0:1783135617.875867:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809197568 00000100:00100000:1.0:1783135617.875891:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135617.875898:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+22:3646:x1869752809197440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135617.875909:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135617.875924:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51ae00/0xf7de4ef628edfc86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edfc7f expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.875937:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135617.876006:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+21:3646:x1869752809197440:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (3001us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135617.876013:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135617.876029:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135617.876034:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+20:3648:x1869752809197568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135617.876040:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135617.876049:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac640031400/0xf7de4ef628edf4ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf4e5 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135617.876058:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135617.876083:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:3648:x1869752809197568:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135617.876108:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135617.876140:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809197568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135617.876161:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135617.876177:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809197440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135617.876335:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783135617.876774:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf63c 00000100:00080000:3.0:1783135617.876781:0:15068:0:(import.c:65:import_set_state_nolock()) ffff8ac67c165800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783135617.876825:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac646dbe000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000001:00000004:2.0:1783135617.876895:0:15068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:2.0:1783135617.877028:0:15068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac67c2e5000): rc 0 00000004:00000080:2.0:1783135617.877037:0:15068:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa3f9c7b0bae0 00000100:00080000:2.0:1783135617.877056:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783135617.877060:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000020:00000080:3.0:1783135617.877133:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c47b000 for lustre-MDT0000 00010000:00010000:1.0:1783135617.878168:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135617.880190:0:15068:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783135617.880229:0:15068:0:(import.c:65:import_set_state_nolock()) ffff8ac67c2e1800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783135617.880376:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809197696:0@lo:39:umount.0 00000100:00100000:1.0:1783135617.880463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135617.880529:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809197696 00000100:00100000:0.0:1783135617.880537:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809197696 00000100:00100000:0.0:1783135617.880605:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1783135617.880615:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1869752809197696:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783135617.880647:0:13344:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf6c8 00000100:00080000:0.0:1783135617.880657:0:13344:0:(import.c:65:import_set_state_nolock()) ffff8ac67c58d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135617.880679:0:13344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1783135617.880701:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783135617.880707:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:2.0:1783135617.880721:0:15068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1783135617.880795:0:15068:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1783135617.880808:0:15068:0:(import.c:65:import_set_state_nolock()) ffff8ac67e2db800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1783135617.880832:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783135617.880834:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1783135617.880842:0:15068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783135617.880869:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3645:x1869752809197696:12345-0@lo:39:umount.0 Request processed in 254us (405us total) trans 4294967301 rc 0/0 00000100:00080000:2.0:1783135617.880899:0:15068:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1783135617.880910:0:15068:0:(import.c:65:import_set_state_nolock()) ffff8ac5439cf800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1783135617.880956:0:15068:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8ac672dccd40) has no exports 00010000:00010000:1.0:1783135617.881201:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135617.881213:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809197824:0@lo:9:umount.0 00000100:00100000:1.0:1783135617.881445:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135617.881470:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809197952:0@lo:9:umount.0 00000100:00100000:0.0:1783135617.881482:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1783135617.881495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783135617.881530:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c2e1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783135617.881537:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809197824 00000100:00100000:1.0:1783135617.881538:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809197696:0@lo:39:umount.0 00000100:00100000:0.0:1783135617.881543:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809197824 00000100:00100000:1.0:1783135617.881572:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809197952 00000100:00100000:1.0:1783135617.881577:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809197952 00000100:00100000:0.0:1783135617.881587:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783135617.881597:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1869752809197824:12345-0@lo:9:umount.0 00000100:00100000:1.0:1783135617.881609:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783135617.881618:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1869752809197952:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783135617.881631:0:8620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf818 00000020:00000080:1.0:1783135617.881634:0:8437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf968 00000100:00080000:0.0:1783135617.881641:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8ac542777800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1783135617.881642:0:8437:0:(import.c:65:import_set_state_nolock()) ffff8ac5439c8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783135617.881681:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000001:00000004:0.0:1783135617.881689:0:8620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1783135617.881799:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3645:x1869752809197952:12345-0@lo:9:umount.0 Request processed in 182us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135617.881807:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783135617.881812:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3645:x1869752809197824:12345-0@lo:9:umount.0 Request processed in 216us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135617.881820:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1783135617.881828:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135617.881842:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135617.881847:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135617.881849:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67e2db800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1783135617.881858:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783135617.881861:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783135617.881865:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135617.881869:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809197824:0@lo:9:umount.0 00000100:00080000:1.0:1783135617.881880:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac5439cf800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783135617.881888:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783135617.881889:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135617.881891:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809197952:0@lo:9:umount.0 00000020:00080000:0.0:1783135617.893563:0:15068:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8ac672dccd40) has no exports 00010000:00010000:1.0:1783135617.903457:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783135617.966760:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf540 00000020:00000080:0.0:1783135617.966780:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac67b021800/lustre-QMT0000_UUID 00000020:01000000:0.0:1783135617.966853:0:15068:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1783135617.967148:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135617.967161:0:15068:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783135617.967165:0:15068:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8ac6608e4d40) has no exports 00000020:00000080:2.0:1783135617.967392:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf539 00000020:00000080:2.0:1783135617.967400:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac6743ee800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783135617.967785:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b021800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783135617.967879:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac6743ee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783135617.967946:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135617.967957:0:15068:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783135617.967961:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac66bed4800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783135617.967964:0:15068:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac66bed4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783135617.967981:0:15068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000040:00080000:2.0:1783135618.799626:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783135618.927692:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783135618.930319:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783135618.930337:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1783135618.930342:0:7453:0:(genops.c:906:class_export_put()) final put ffff8ac67c3d0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783135618.930367:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000001:00080000:0.0:1783135618.930373:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1783135618.930376:0:7453:0:(genops.c:906:class_export_put()) final put ffff8ac67c629000/eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000001:00100000:0.0:1783135618.930381:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000001:00080000:0.0:1783135618.930384:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1783135618.930386:0:7453:0:(genops.c:906:class_export_put()) final put ffff8ac54392c000/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000001:00100000:1.0:1783135618.930504:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135618.930509:0:9520:0:(genops.c:906:class_export_put()) final put ffff8ac67c62f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783135618.930519:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000020:00000080:1.0:1783135618.930521:0:9520:0:(genops.c:906:class_export_put()) final put ffff8ac543a8e000/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000020:00000080:3.0:1783135618.931425:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c3d0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1783135618.931509:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c629000/eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 for lustre-MDT0001 00000020:00000080:3.0:1783135618.931548:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac54392c000/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe for lustre-MDT0001 00000020:00000080:3.0:1783135618.931569:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c62f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783135618.931590:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac543a8e000/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe for lustre-OST0001 00000020:00000080:3.0:1783135618.931605:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c58d000 for lustre-MDT0001 00000020:00000080:3.0:1783135618.931610:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c629800 for lustre-MDT0001 00000020:00000080:3.0:1783135618.931613:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac543928800 for lustre-MDT0001 00000020:00000080:3.0:1783135618.931616:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac5439c8800 for lustre-OST0001 00000020:00000080:3.0:1783135618.931619:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac543a8b800 for lustre-OST0001 00000001:00100000:2.0:1783135618.933620:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135618.933629:0:8431:0:(genops.c:906:class_export_put()) final put ffff8ac542777000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1783135618.933657:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000020:00000080:2.0:1783135618.933659:0:8431:0:(genops.c:906:class_export_put()) final put ffff8ac65077e800/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe 00000020:00000080:0.0:1783135618.933734:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac542777000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783135618.933793:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac65077e800/393908cf-d54e-4d7c-b6e6-bcde2fa6fefe for lustre-OST0000 00000020:00000080:0.0:1783135618.933820:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac542777800 for lustre-OST0000 00000020:00000080:0.0:1783135618.933824:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac65077a000 for lustre-OST0000 00000100:00100000:1.0:1783135619.438517:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135619.438544:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809198080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135619.438690:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135619.438792:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809198080 00000100:00100000:1.0:1783135619.438800:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809198080 00000100:00100000:1.0:1783135619.438861:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783135619.438871:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809198080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135619.438900:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783135619.438974:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809198080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135619.438983:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783135619.439031:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809198080:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783135619.439195:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135619.439203:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135619.439215:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809198208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135619.439247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135619.439328:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809198208 00000100:00100000:2.0:1783135619.439333:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809198208 00000100:00100000:2.0:1783135619.439376:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783135619.439384:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809198208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135619.439400:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1783135619.439434:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809198208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135619.439440:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:0.0:1783135619.439583:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135619.439607:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809198208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135619.440241:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac542798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809198464:0@lo:400:kworker.0 00000100:00100000:3.0:1783135619.440279:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135619.440302:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809198976:0@lo:400:kworker.0 00000100:00100000:3.0:1783135619.440327:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135619.440345:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783135619.440350:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809198592:0@lo:400:kworker.0 00000100:00100000:3.0:1783135619.440368:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135619.440384:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809199104:0@lo:400:kworker.0 00000100:00100000:3.0:1783135619.440404:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135619.440430:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809198464 00000100:00100000:3.0:1783135619.440436:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809198464 00000100:00100000:3.0:1783135619.440465:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783135619.440480:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1869752809198464:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783135619.440487:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783135619.440517:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3648:x1869752809198464:12345-0@lo:400:kworker.0 Request processed in 37us (237us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783135619.440523:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1783135619.440544:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809198976 00000100:00100000:3.0:1783135619.440548:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809198976 00000100:00100000:3.0:1783135619.440567:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809198592 00000100:00100000:3.0:1783135619.440569:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809198592 00000100:00100000:3.0:1783135619.440580:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809199104 00000100:00100000:3.0:1783135619.440582:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809199104 00000100:00100000:3.0:1783135619.440603:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1783135619.440610:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809199104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135619.440644:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809199104:12345-0@lo:400:kworker.0 Request processed in 35us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135619.440649:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1783135619.440661:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783135619.440664:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1869752809198976:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783135619.440668:0:8461:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783135619.440809:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783135619.440815:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1869752809198592:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783135619.440820:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783135619.440850:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1869752809198592:12345-0@lo:400:kworker.0 Request processed in 34us (481us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783135619.440855:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783135619.440877:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809198720:0@lo:400:kworker.0 00000100:00100000:2.0:1783135619.440907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135619.440932:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783135619.440947:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809198336:0@lo:400:kworker.0 00000100:00100000:2.0:1783135619.440975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135619.440993:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809198848:0@lo:400:kworker.0 00000100:00100000:2.0:1783135619.441011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135619.441032:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809198720 00000100:00100000:2.0:1783135619.441036:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809198720 00000100:00100000:2.0:1783135619.441049:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809198848 00000100:00100000:2.0:1783135619.441051:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809198848 00000100:00100000:2.0:1783135619.441067:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1783135619.441072:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809198848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135619.441126:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809198848:12345-0@lo:400:kworker.0 Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135619.441131:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1783135619.441142:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783135619.441146:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1869752809198720:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783135619.441150:0:13464:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1783135619.441169:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1869752809198720:12345-0@lo:400:kworker.0 Request processed in 22us (262us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783135619.441184:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00080000:2.0:1783135619.441215:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc7100 x1869752809198848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135619.441227:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809198848:0@lo:400:kworker.0 00000100:00080000:2.0:1783135619.441237:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783135619.441241:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1783135619.441245:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1783135619.442133:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809198336 00000100:00100000:0.0:1783135619.442141:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809198336 00000100:00100000:0.0:1783135619.442183:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1783135619.442192:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:3646:x1869752809198336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135619.442242:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac658030450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49+19:3646:x1869752809198336:12345-0@lo:400:kworker.0 Request processed in 51us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135619.442248:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00080000:0.0:1783135619.442286:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783135619.442346:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783135619.442350:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ac64346e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783135619.442353:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783135619.442358:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ac64346e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135619.442361:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 251 00000100:00080000:0.0:1783135619.442367:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ac64346e800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135619.442392:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438af800 x1869752809199232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135619.442413:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809198592:0@lo:400:kworker.0 00010000:00080000:0.0:1783135619.442427:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543bc4700 x1869752809199104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135619.442436:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809199104:0@lo:400:kworker.0 00000100:00080000:0.0:1783135619.442446:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783135619.442449:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ac67c164000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783135619.442452:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783135619.442456:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ac67c164000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135619.442459:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 251 00000100:00080000:0.0:1783135619.442462:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ac67c164000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135619.442474:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438ae680 x1869752809199360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135619.442483:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac542798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809198464:0@lo:400:kworker.0 00000100:00100000:3.0:1783135619.443148:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3648:x1869752809198976:12345-0@lo:400:kworker.0 Request processed in 2475us (2813us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783135619.443158:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1783135619.444083:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869752809199232:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783135619.444178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135619.444216:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809199360:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783135619.444244:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135619.444291:0:13344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809199360 00000100:00100000:1.0:1783135619.444299:0:13344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809199360 00000100:00100000:1.0:1783135619.444332:0:13344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1783135619.444339:0:13344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869752809199360:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1783135619.444355:0:13344:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1783135619.444446:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783135619.444466:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6f8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783135619.444470:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783135619.444475:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6f8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135619.444479:0:3648:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 301 00000100:00080000:0.0:1783135619.444485:0:3648:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ac67c6f8800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135619.444510:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438aca80 x1869752809199488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135619.444530:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809198976:0@lo:400:kworker.0 00000100:00100000:0.0:1783135619.444578:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869752809199488:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1783135619.444604:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135619.444685:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809199232 00000100:00100000:3.0:1783135619.444690:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809199232 00000100:00100000:3.0:1783135619.444718:0:13464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809199488 00000100:00100000:3.0:1783135619.444720:0:13464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809199488 00000100:00100000:3.0:1783135619.444740:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783135619.444745:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1869752809199232:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1783135619.444753:0:13464:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783135619.444811:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1869752809199232:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 64us (633us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783135619.444817:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783135619.444834:0:13464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1783135619.444838:0:13464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1869752809199488:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1783135619.444844:0:13464:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783135619.444867:0:13464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1869752809199488:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 27us (262us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783135619.444871:0:13464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1783135619.444897:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135619.444902:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135619.444904:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869752809199488:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1783135619.444913:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac64346e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135619.444916:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135619.444918:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869752809199232:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1783135619.472898:0:13344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869752809199360:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 28548us (28643us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135619.472916:0:13344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:3.0:1783135619.474595:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c164000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135619.474608:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135619.474612:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809199360:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1783135619.487654:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135619.487668:0:3646:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 273 00000100:00080000:2.0:1783135619.487756:0:3646:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ac5424bf000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135619.487873:0:3646:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438b2a00 x1869752809199616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135619.487951:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869752809199616:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783135619.488108:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135619.488277:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809198720:0@lo:400:kworker.0 00000100:00100000:2.0:1783135619.488326:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54279ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3646:1869752809198336:0@lo:400:kworker.0 00000100:00100000:0.0:1783135619.490936:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809199616 00000100:00100000:0.0:1783135619.491319:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809199616 00000100:00100000:0.0:1783135619.491384:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1783135619.491393:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869752809199616:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1783135619.491410:0:8461:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1783135619.492424:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1869752809199616:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 1025us (4310us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135619.492436:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1783135619.492523:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135619.492530:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135619.492535:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869752809199616:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1783135619.950320:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135620.975701:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783135620.978401:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783135620.978413:0:6501:0:(genops.c:906:class_export_put()) final put ffff8ac67c2e5000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1783135620.978441:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000001:00080000:2.0:1783135620.978450:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:2.0:1783135620.978453:0:6501:0:(genops.c:906:class_export_put()) final put ffff8ac67c62c000/eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 00000020:00000080:3.0:1783135620.981930:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c2e5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783135620.982025:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c62c000/eddebdfd-ef8c-4eb2-9ae8-1e465ec38a40 for lustre-MDT0000 00000020:00000080:3.0:1783135620.982052:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c165800 for lustre-MDT0000 00000020:00000080:3.0:1783135620.982056:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c62e800 for lustre-MDT0000 00010000:00010000:1.0:1783135622.001010:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135623.024531:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135624.049509:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783135624.053056:0:15068:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ac543856f00 - data ffff8ac66af1f000/ffff8ac543066800 00000020:01000000:0.0:1783135624.053378:0:15068:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ac64893d720 - data ffff8ac66ac26d80/ffff8ac67b25e800 00000001:00000004:0.0:1783135624.064362:0:15068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:1.0:1783135624.103004:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783135624.103014:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1783135624.103033:0:15068:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ac5438b3800 x1869752809197696/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783135627 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135624.103072:0:15068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783135624.105260:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783135624.105268:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:1.0:1783135624.105327:0:15068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135624.105330:0:15068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783135624.105562:0:8611:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783135624.105568:0:8611:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1783135624.105576:0:8611:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1783135624.106321:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783135624.106326:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1783135624.106371:0:15068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135624.106373:0:15068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783135624.106575:0:9777:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783135624.106580:0:9777:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1783135624.106588:0:9777:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1783135624.107968:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf508 00000020:00000080:3.0:1783135624.107982:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac643716800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783135624.110349:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf51d 00000020:00000080:3.0:1783135624.110370:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac643713800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135624.110793:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac643716800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783135624.111258:0:15068:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783135624.111266:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135624.111275:0:15068:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783135624.111280:0:15068:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8ac672dc99c0) has no exports 00000004:01000000:3.0:1783135624.111456:0:15068:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783135624.111465:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf953 00000020:00000080:3.0:1783135624.111470:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac5439cc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135624.111534:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac643713800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783135624.111593:0:15068:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783135624.111598:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135624.111608:0:15068:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135624.111611:0:15068:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff8ac543598000) has no exports 00000020:00000080:3.0:1783135624.111617:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf94c 00000020:00000080:3.0:1783135624.111621:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac5439c9800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783135624.111638:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5439cc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1783135624.112068:0:15068:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783135624.112073:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783135624.112077:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1783135624.112083:0:15068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135624.112221:0:15068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783135624.112326:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5439c9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135624.112482:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135624.112494:0:15068:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135624.112500:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf811 00000020:00000080:3.0:1783135624.112505:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac67c6fe800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135624.112535:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac5439cf800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783135624.112543:0:13713:0:(genops.c:906:class_export_put()) final put ffff8ac67c5e8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135624.112545:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c5e8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783135624.112550:0:13713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783135624.112679:0:15068:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783135624.112683:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135624.112690:0:15068:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135624.112692:0:15068:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff8ac67e2d19c0) has no exports 00000020:00000080:3.0:1783135624.112697:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf80a 00000020:00000080:3.0:1783135624.112701:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac67c161800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135624.112722:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c6fe800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1783135624.113190:0:15068:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783135624.113196:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783135624.113199:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:3.0:1783135624.113204:0:15068:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135624.113205:0:15068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135624.113398:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c161800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135624.113478:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135624.113486:0:15068:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1783135624.113499:0:15068:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1783135624.113505:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf6c1 00000020:00000080:3.0:1783135624.113510:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac67b4c6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135624.113526:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67e2db800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783135624.113532:0:13713:0:(genops.c:906:class_export_put()) final put ffff8ac67b4c7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135624.113534:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b4c7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783135624.113539:0:13713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783135624.113640:0:15068:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1783135624.113644:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135624.113649:0:15068:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135624.113652:0:15068:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8ac658014d40) has no exports 00000020:00000080:3.0:1783135624.113657:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf6ba 00000020:00000080:3.0:1783135624.113660:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac67c3d1800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135624.113680:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b4c6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1783135624.114683:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c3d1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783135624.131159:0:15068:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783135624.131168:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783135624.131173:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1783135624.131182:0:15068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135624.131241:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135624.131256:0:15068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135624.131284:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135624.131288:0:15068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135624.131294:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac658086000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135624.131299:0:15068:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac658086000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783135624.131309:0:15068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135624.131419:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf524 00000020:00000080:2.0:1783135624.131426:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac643716000/lustre-MDD0000_UUID 00000020:01000000:2.0:1783135624.131432:0:15068:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783135624.131436:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135624.131441:0:15068:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783135624.131455:0:15068:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8ac672dc8000) has no exports 00000020:00000080:2.0:1783135624.131473:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135624.131477:0:15068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783135624.131482:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf52b 00000020:00000080:2.0:1783135624.131486:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac643715800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783135624.131495:0:15068:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac64382e000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783135624.131498:0:15068:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac64382e000 3 00000020:01000004:2.0:1783135624.131502:0:15068:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ac64382e000 from lustre-MDT0000 00000020:00000080:2.0:1783135624.131519:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135624.131523:0:15068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783135624.131525:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac643712000/lustre-MDT0000_UUID 00000020:00000080:2.0:1783135624.131527:0:15068:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac643712000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783135624.131534:0:15068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783135624.131564:0:15068:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783135624.131568:0:15068:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783135624.131571:0:15068:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783135624.131574:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135624.131576:0:15068:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783135624.131583:0:15068:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8ac672d64000 dfae7aea-4aeb-4043-b6ee-9086d4d5ab49 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783135624.131588:0:15068:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8ac672dcb380) has exports, disconnecting them 00000020:00080000:2.0:1783135624.131592:0:15068:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ac672d64000), last request at 1783135324 00000020:00000080:2.0:1783135624.131606:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf4c9 00000020:00010000:2.0:1783135624.131610:0:15068:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8ac672d64000: total 2 00000100:00080000:2.0:1783135624.131614:0:15068:0:(import.c:65:import_set_state_nolock()) ffff8ac672d61000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783135624.131624:0:15068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac672d64000): rc 0 00000020:00080000:2.0:1783135624.131628:0:15068:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8ac672dcb380) has no exports 00000100:00100000:2.0:1783135624.131710:0:6517:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ac65280d600:6517] 2 exiting: rc = 0 00000020:00010000:1.0:1783135624.132173:0:8453:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8ac672d64000: total 2 00010000:00010000:1.0:1783135624.132220:0:8453:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8ac672d64000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783135624.132251:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527600/0xf7de4ef628edfc78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edfc71 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132268:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65c000/0xf7de4ef628edf8ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf8e3 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132283:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65dc00/0xf7de4ef628edfa3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edfa33 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132293:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628edf9ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf9c3 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132303:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65c400/0xf7de4ef628edf9d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf9d1 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132327:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51ac00/0xf7de4ef628edf9e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf9df expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132337:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65da00/0xf7de4ef628edf9f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf9ed expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132346:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527200/0xf7de4ef628edfa02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf9fb expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132357:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c51be00/0xf7de4ef628edfa10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edfa09 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132369:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628edf5d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf5cc expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132381:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628edfc5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edfc55 expref: 4 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132392:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527000/0xf7de4ef628edfc6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edfc63 expref: 3 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132403:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac6413e8000/0xf7de4ef628edf5c5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf7de4ef628edf5be expref: 2 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135624.132414:0:8453:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8ac672d64000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783135624.132431:0:8453:0:(genops.c:906:class_export_put()) final put ffff8ac672d64000/dfae7aea-4aeb-4043-b6ee-9086d4d5ab49 00010000:00010000:1.0:1783135624.132437:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135624.132439:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135624.132441:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783135624.132458:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c2e1800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1783135624.132466:0:13713:0:(genops.c:906:class_export_put()) final put ffff8ac67c3d7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135624.132469:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c3d7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1783135624.132477:0:13713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135624.132518:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac643716000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783135624.132522:0:13713:0:(genops.c:906:class_export_put()) final put ffff8ac643715000/lustre-MDD0000_UUID 00000020:00000080:1.0:1783135624.132524:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac643715000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783135624.132528:0:13713:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783135624.132552:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac643715800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783135624.132556:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac672d64000/dfae7aea-4aeb-4043-b6ee-9086d4d5ab49 for MGS 00000100:00100000:0.0:1783135624.132670:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ac6482afc00:6515] 0 exiting: rc = 1 00000100:00100000:0.0:1783135624.132739:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ac65280d000:6516] 1 exiting: rc = 0 00000100:00100000:2.0:1783135624.132986:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.132994:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133000:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133006:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133010:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133023:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133028:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133033:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133038:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133043:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133048:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133054:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133060:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133065:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133071:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133077:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133083:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133107:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133113:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133119:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133124:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133129:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133134:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133139:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133145:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133150:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133155:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133161:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133166:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133172:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133177:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133182:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133188:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133193:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133199:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133205:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133209:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133215:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133220:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133225:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133238:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133243:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133248:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133253:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133258:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133263:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133269:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133274:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133279:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133284:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133290:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133295:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133301:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133307:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133312:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133317:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133323:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133328:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133333:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133339:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133344:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133349:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133354:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135624.133359:0:15068:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783135624.133948:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac672d61000 for MGS 00000020:01000000:1.0:1783135624.135427:0:15068:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ac543856c60 - data ffff8ac66af1fca8/ffff8ac543066400 00000020:01000000:1.0:1783135624.135547:0:15068:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ac648566720 - data ffff8ac66ac88360/ffff8ac672e10400 00000020:00000080:1.0:1783135624.136017:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf4ad 00000020:00000080:1.0:1783135624.136027:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac64b2c8800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783135624.136051:0:15068:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac64382e000 from MGS, refs=2 00000020:01000004:1.0:1783135624.136055:0:15068:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac64382e000 2 00000020:01000004:1.0:1783135624.136058:0:15068:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ac64382e000 from MGS 00000020:00000080:1.0:1783135624.136081:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135624.136114:0:15068:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783135624.136118:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac64b2c9800/MGS 00000020:00000080:1.0:1783135624.136121:0:15068:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac64b2c9800/MGS for MGS 00000020:01000000:1.0:1783135624.136131:0:15068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783135624.136197:0:15068:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783135624.136201:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135624.136206:0:15068:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783135624.136212:0:15068:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ac6743e9800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783135624.136217:0:15068:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8ac6608e0000) has exports, disconnecting them 00000020:00080000:1.0:1783135624.136222:0:15068:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ac6743e9800), last request at 1783135324 00000020:00000080:1.0:1783135624.136226:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf578 00000020:00080000:1.0:1783135624.136247:0:15068:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac6743e9800): rc 0 00000020:00000080:1.0:1783135624.136252:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac6743e9800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783135624.136888:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac64b2c8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783135624.136898:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac6743e9800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783135624.145170:0:15068:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783135624.145181:0:15068:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135624.145186:0:15068:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135624.145194:0:15068:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135624.145228:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac66bed5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783135624.145370:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135624.145379:0:15068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1783135624.145394:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac6743e8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783135624.145398:0:15068:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac6743e8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783135624.145405:0:15068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783135624.145484:0:15068:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac64382e000 1 00000020:00000080:2.0:1783135624.145490:0:15068:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf49f 00000020:00000080:2.0:1783135624.145496:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac64b2cb000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1783135624.145506:0:15068:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783135624.145514:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac64b2cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783135624.145524:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135624.145529:0:15068:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783135624.145532:0:15068:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8ac66b58b380) has no exports 00000020:00000080:2.0:1783135624.228082:0:15068:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135624.229198:0:15068:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783135624.229203:0:15068:0:(genops.c:906:class_export_put()) final put ffff8ac647216000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135624.229208:0:15068:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac647216000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783135624.229215:0:15068:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783135624.229330:0:15068:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ac64382f000 00000020:02000400:2.0:1783135624.229403:0:15068:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1783135624.558425:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135624.558448:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809199744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135624.558527:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135624.558593:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809199744 00000100:00100000:0.0:1783135624.558602:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809199744 00000100:00100000:0.0:1783135624.558658:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783135624.558667:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809199744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135624.558696:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1783135624.558739:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809199744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135624.558746:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:0.0:1783135624.558767:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135624.558806:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809199744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135624.559211:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135624.559221:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809199872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135624.559252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135624.559280:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809199872 00000100:00100000:1.0:1783135624.559284:0:10560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809199872 00000100:00100000:1.0:1783135624.559312:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783135624.559318:0:10560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809199872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135624.559336:0:10560:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1783135624.559369:0:10560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809199872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135624.559375:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783135624.559406:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809199872:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783135624.560372:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135624.571363:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135624.571371:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783135624.571374:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac67c164000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135624.571383:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1783135624.571388:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783135624.571395:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ac67c164000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135624.571418:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac543b3d880 x1869752809200128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135624.571434:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135624.571437:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783135624.571439:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac64346e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135624.571442:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1783135624.571459:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783135624.571463:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ac64346e800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135624.571475:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac543b3c000 x1869752809200256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135624.571484:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135624.571487:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783135624.571489:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135624.571492:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1783135624.571494:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783135624.571496:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ac5424bf000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135624.571505:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac543b3d500 x1869752809200384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135624.571522:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135624.571525:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783135624.571526:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6f8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135624.571530:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 523 00000100:00080000:1.0:1783135624.571532:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783135624.571535:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ac67c6f8800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135624.571547:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67b3b0000 x1869752809200640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135624.571603:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809200512:0@lo:400:kworker.0 00000100:00100000:1.0:1783135624.571686:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135624.571750:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135624.571756:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809200000:0@lo:400:kworker.0 00000400:00000100:1.0:1783135624.571788:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752809200000 offset 0 length 224: 4 00000100:00100000:1.0:1783135624.571814:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809200128:0@lo:38:kworker.0 00000100:00100000:1.0:1783135624.571840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135624.571871:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869752809200256:0@lo:38:kworker.0 00000100:00100000:1.0:1783135624.572010:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135624.572029:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869752809200384:0@lo:38:kworker.0 00000100:00100000:1.0:1783135624.572048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135624.572063:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869752809200640:0@lo:38:kworker.0 00000100:00100000:1.0:1783135624.572081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135624.572146:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809200512 00000100:00100000:1.0:1783135624.572156:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809200512 00000100:00100000:1.0:1783135624.572206:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809200256 00000100:00100000:1.0:1783135624.572210:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809200256 00000100:00100000:1.0:1783135624.572222:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809200384 00000100:00100000:1.0:1783135624.572223:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809200384 00000100:00100000:1.0:1783135624.572230:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809200640 00000100:00100000:1.0:1783135624.572231:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809200640 00000100:00100000:1.0:1783135624.572241:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1783135624.572251:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809200512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135624.572306:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809200512:12345-0@lo:400:kworker.0 Request processed in 56us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135624.572313:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:1.0:1783135624.572330:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1783135624.572334:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809200256:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783135624.572352:0:6524:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135624.572405:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809200256:12345-0@lo:38:kworker.0 Request processed in 69us (394us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135624.572421:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1783135624.572433:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1783135624.572437:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809200384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783135624.572446:0:6524:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135624.572471:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809200384:12345-0@lo:38:kworker.0 Request processed in 32us (422us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135624.572477:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1783135624.572487:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1783135624.572490:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809200640:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783135624.572499:0:6524:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135624.572521:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809200640:12345-0@lo:38:kworker.0 Request processed in 29us (439us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135624.572526:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1783135624.572545:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809200128 00000100:00100000:1.0:1783135624.572549:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809200128 00000100:00100000:1.0:1783135624.572568:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1783135624.572572:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869752809200128:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1783135624.572580:0:6528:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135624.572605:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869752809200128:12345-0@lo:38:kworker.0 Request processed in 31us (765us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135624.572610:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00010000:00080000:1.0:1783135624.572656:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac54379c000 x1869752809200512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135624.572669:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac54379c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809200512:0@lo:400:kworker.0 00000100:00080000:1.0:1783135624.572703:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135624.572714:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809200768:0@lo:400:kworker.0 00000100:00080000:2.0:1783135624.574399:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c164000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135624.574410:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135624.574415:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809200128:0@lo:38:kworker.0 00000100:00080000:2.0:1783135624.574427:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac64346e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135624.574430:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135624.574433:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869752809200256:0@lo:38:kworker.0 00000100:00080000:2.0:1783135624.574443:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135624.574446:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135624.574449:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869752809200384:0@lo:38:kworker.0 00000100:00080000:2.0:1783135624.574458:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135624.574478:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135624.574481:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869752809200640:0@lo:38:kworker.0 00000100:00100000:1.0:1783135624.574881:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135624.575305:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809200768 00000100:00100000:2.0:1783135624.575314:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809200768 00000100:00100000:2.0:1783135624.575395:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1783135624.575406:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809200768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135624.575474:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809200768:12345-0@lo:400:kworker.0 Request processed in 70us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135624.575481:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00080000:1.0:1783135624.576038:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1783135624.576074:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b1180 x1869752809200768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135624.576119:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809200768:0@lo:400:kworker.0 00010000:00010000:1.0:1783135625.072645:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135626.094436:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135627.119404:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135628.016004:0:13817:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783135628.149834:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783135628.152019:0:15269:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783135628.179424:0:15269:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1783135628.179491:0:15269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.179507:0:15269:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.179514:0:15269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.179521:0:15269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.179548:0:15269:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783135628.179554:0:15269:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783135628.179582:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135628.179586:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783135628.179591:0:15269:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783135628.179598:0:15269:0:(import.c:65:import_set_state_nolock()) ffff8ac64346e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1783135628.179616:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135628.179618:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783135628.179621:0:15269:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783135628.180591:0:15269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.180605:0:15269:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.180611:0:15269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.180617:0:15269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.180637:0:15269:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783135628.180654:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135628.180660:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.180666:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20ec00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135628.180669:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.180678:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135628.180684:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135628.180690:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135628.180702:0:8452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783135628.180704:0:8452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783135628.180927:0:15269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.180936:0:15269:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.180943:0:15269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.180950:0:15269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.180971:0:15269:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135628.180976:0:15269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.180994:0:15269:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.181000:0:15269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.181005:0:15269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.181016:0:15269:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783135628.181021:0:15269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.181027:0:15269:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.181032:0:15269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.181038:0:15269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135628.181044:0:15269:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1783135628.181047:0:15269:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1783135628.181074:0:15269:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1783135628.181078:0:15269:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1783135628.181081:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135628.181105:0:15269:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783135628.181113:0:15269:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8ac67c2fd000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135628.181124:0:15269:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff8ac5424bf800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135628.181129:0:15269:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff8ac67b4bb380) has exports, disconnecting them 00000020:00080000:0.0:1783135628.181133:0:15269:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ac67c2fd000), last request at 1783135624 00000020:00000080:0.0:1783135628.181139:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf8ab 00000100:00080000:0.0:1783135628.181194:0:15269:0:(import.c:65:import_set_state_nolock()) ffff8ac67c2fb000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783135628.181235:0:15269:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac67c2fd000): rc 0 00000020:00000080:0.0:1783135628.181238:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67c2fd000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1783135628.181249:0:15269:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ac5424bf800), last request at 1783135624 00000020:00000080:0.0:1783135628.181252:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf785 00000100:00080000:0.0:1783135628.181257:0:15269:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bd800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783135628.181266:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c2fd000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1783135628.181302:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c2fb000 for lustre-MDT0001 00000020:00080000:0.0:1783135628.181315:0:15269:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac5424bf800): rc 0 00000020:00000080:0.0:1783135628.181318:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac5424bf800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1783135628.181327:0:15269:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa3f9c1cb3ae0 00000020:00000080:0.0:1783135628.181338:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5424bf800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1783135628.181359:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac5424bd800 for lustre-MDT0001 00000100:00080000:0.0:1783135628.181378:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135628.181382:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1783135628.181992:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783135628.182001:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182009:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65ce00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135628.182012:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182035:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135628.182042:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135628.182048:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135628.182051:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1783135628.182054:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1783135628.182107:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182113:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135628.182138:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182146:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c65ce00/0xf7de4ef628edfa09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa10 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182160:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783135628.182163:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182169:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c800 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135628.182172:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182179:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135628.182197:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135628.182202:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135628.182204:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1783135628.182206:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783135628.182222:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182228:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135628.182243:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182250:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c65c800/0xf7de4ef628edf8e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf8ea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182263:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135628.182267:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182272:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527a00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135628.182275:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182281:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135628.182287:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135628.182302:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783135628.182304:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783135628.182306:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783135628.182321:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182327:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135628.182333:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182339:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c527a00/0xf7de4ef628edfc71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfc78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182347:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135628.182351:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182356:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac640031800 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135628.182358:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182364:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135628.182370:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135628.182375:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135628.182377:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783135628.182379:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783135628.182399:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182405:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135628.182412:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182418:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac640031800/0xf7de4ef628edf5cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edf5d3 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135628.182430:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135628.182431:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135628.182433:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135628.182441:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135628.182464:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809200896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135628.182537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135628.182593:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135628.182599:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809201280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135628.182620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135628.183107:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135628.183945:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.183957:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135628.183969:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.183978:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628edf9fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf7de4ef628edfa02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135628.183990:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135628.183992:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135628.183993:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135628.184104:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809201408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135628.184142:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135628.184178:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809201024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135628.184199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135628.184220:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135628.184225:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809201152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135628.184245:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135628.184285:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809200896 00000100:00100000:3.0:1783135628.184292:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809200896 00000100:00100000:3.0:1783135628.184345:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809201280 00000100:00100000:3.0:1783135628.184350:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809201280 00000100:00100000:3.0:1783135628.184359:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809201408 00000100:00100000:3.0:1783135628.184361:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809201408 00000100:00100000:3.0:1783135628.184367:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809201024 00000100:00100000:3.0:1783135628.184369:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809201024 00000100:00100000:3.0:1783135628.184375:0:10345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809201152 00000100:00100000:3.0:1783135628.184377:0:10345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809201152 00000100:00100000:3.0:1783135628.184388:0:10345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135628.184395:0:10345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac648bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3647:x1869752809200896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783135628.184402:0:10345:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135628 with bad export cookie 17860799991353570505 00000100:00100000:1.0:1783135628.184903:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135628.184909:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3647:x1869752809201280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783135628.184914:0:10346:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135628 with bad export cookie 17860799991353570505 00000100:00100000:1.0:1783135628.184985:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3647:x1869752809201280:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (2363us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783135628.184992:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135628.185012:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135628.185016:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3647:x1869752809201408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783135628.185020:0:10346:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135628 with bad export cookie 17860799991353570505 00000100:00100000:1.0:1783135628.185045:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3647:x1869752809201408:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (902us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783135628.185051:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135628.185063:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135628.185067:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3648:x1869752809201024:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783135628.185080:0:10346:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135628 with bad export cookie 17860799991353570505 00000100:00100000:1.0:1783135628.185128:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3648:x1869752809201024:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (928us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783135628.185134:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135628.185148:0:10346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135628.185151:0:10346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3648:x1869752809201152:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783135628.185155:0:10346:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135628 with bad export cookie 17860799991353570505 00000100:00100000:1.0:1783135628.185178:0:10346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:0+-99:3648:x1869752809201152:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (931us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783135628.185184:0:10346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1783135628.185223:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783135628.185228:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2ce000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1783135628.185231:0:3648:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1783135628.187009:0:15269:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783135628.187019:0:15269:0:(import.c:65:import_set_state_nolock()) ffff8ac67c164000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1783135628.187248:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783135628.187253:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1783135628.187267:0:15269:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783135628.187326:0:15269:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783135628.187355:0:15269:0:(import.c:65:import_set_state_nolock()) ffff8ac542771800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783135628.187381:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783135628.187395:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1783135628.187404:0:15269:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783135628.187468:0:15269:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783135628.187480:0:15269:0:(import.c:65:import_set_state_nolock()) ffff8ac54392b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783135628.187508:0:15269:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8ac67b4bb380) has no exports 00000100:00100000:2.0:1783135628.188161:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809201536:0@lo:9:umount.0 00000100:00100000:2.0:1783135628.188234:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135628.188273:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809201664:0@lo:9:umount.0 00000100:00100000:2.0:1783135628.188296:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135628.188480:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809201536 00000100:00100000:2.0:1783135628.188490:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809201536 00000100:00100000:2.0:1783135628.188541:0:8620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809201664 00000100:00100000:2.0:1783135628.188545:0:8620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809201664 00000100:00100000:2.0:1783135628.188570:0:8620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783135628.188579:0:8620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1869752809201536:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783135628.188606:0:8620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf7d2 00000100:00080000:2.0:1783135628.188614:0:8620:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6ff800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783135628.188892:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783135628.188902:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1869752809201664:12345-0@lo:9:umount.0 00000020:00000080:0.0:1783135628.188916:0:8435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf91b 00000100:00080000:0.0:1783135628.188921:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6fa800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783135628.188988:0:8620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1783135628.189150:0:8620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3645:x1869752809201536:12345-0@lo:9:umount.0 Request processed in 571us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135628.189158:0:8620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1783135628.189222:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac542771800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783135628.189233:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783135628.189235:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135628.189239:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809201536:0@lo:9:umount.0 00000001:00000004:0.0:1783135628.190167:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1783135628.190332:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3645:x1869752809201664:12345-0@lo:9:umount.0 Request processed in 1430us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135628.190344:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1783135628.190500:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135628.190504:0:6518:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135628.190706:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac54392b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783135628.190872:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783135628.190876:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135628.190881:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809201664:0@lo:9:umount.0 00010000:00010000:2.0:1783135628.190908:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135628.192339:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1783135628.194979:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135628.199075:0:10345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac648bc6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3647:x1869752809200896:12345-0@lo:103:ldlm_bl.0 Request processed in 14673us (16531us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783135628.199119:0:10345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1783135628.225947:0:3648:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.106@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1783135628.225953:0:3648:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783135628.225962:0:3648:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac543b3f480 x1869752809200000/t0(0) o400->MGC192.168.204.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783135640 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135628.226051:0:3648:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac543795500 x1869752809200896/t0(0) o103->MGC192.168.204.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135644 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135628.226061:0:3648:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84c380 x1869752809201280/t0(0) o103->MGC192.168.204.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135644 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135628.226070:0:3648:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67b3b1180 x1869752809201408/t0(0) o103->MGC192.168.204.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135644 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135628.226077:0:3648:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84df80 x1869752809201024/t0(0) o103->MGC192.168.204.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135644 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135628.226116:0:3648:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84ca80 x1869752809201152/t0(0) o103->MGC192.168.204.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135644 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135628.226128:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3649:1869752809200000:0@lo:400:kworker.0 00000100:00080000:0.0:1783135628.226341:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ac64b2ce000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1783135628.226357:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809201280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135628.226365:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809200896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135628.226402:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3647:1869752809201408:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1783135628.229339:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783135628.229350:0:3648:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783135628.229351:0:3648:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783135628.229356:0:3648:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2ce000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135628.229365:0:3648:0:(import.c:512:import_select_connection()) MGC192.168.204.106@tcp: connect to NID 0@lo last attempt 227 00000100:00080000:1.0:1783135628.229377:0:3648:0:(import.c:626:import_select_connection()) MGC192.168.204.106@tcp: import ffff8ac64b2ce000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135628.229471:0:3648:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438b1f80 x1869752809201792/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135628.229526:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809201024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135628.229552:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3648:1869752809201152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135628.229658:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3645:1869752809201792:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1783135628.229707:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752809201792 offset 0 length 520: 4 00000020:00080000:3.0:1783135628.245703:0:15269:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8ac67b4bb380) has no exports 00000020:01000000:2.0:1783135628.318381:0:15269:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ac5426e2f00 - data ffff8ac66aef4ca8/ffff8ac54391ec00 00000020:01000000:2.0:1783135628.318833:0:15269:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ac67c592cc0 - data ffff8ac66adbb5e8/ffff8ac67c511800 00000001:00000004:0.0:1783135628.336369:0:15269:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1783135628.401403:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135628.401412:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1783135628.401421:0:15269:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783135628.407331:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783135628.407340:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1783135628.407438:0:15269:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135628.407441:0:15269:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783135628.410136:0:8603:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783135628.410143:0:8603:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1783135628.410155:0:8603:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783135628.410705:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783135628.410710:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1783135628.410730:0:15269:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135628.410732:0:15269:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783135628.411057:0:9768:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783135628.411061:0:9768:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1783135628.411076:0:9768:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783135628.412857:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf5ef 00000020:00000080:1.0:1783135628.412873:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67b4c4800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1783135628.413549:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b4c4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783135628.415683:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf604 00000020:00000080:1.0:1783135628.415697:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67b4c3000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1783135628.415759:0:15269:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1783135628.415764:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135628.415783:0:15269:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783135628.415788:0:15269:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8ac67b4b8000) has no exports 00000004:01000000:1.0:1783135628.416208:0:15269:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783135628.416219:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf90d 00000020:00000080:1.0:1783135628.416224:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac543928000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783135628.417662:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b4c3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1783135628.417945:0:15269:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783135628.417976:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135628.417992:0:15269:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783135628.417997:0:15269:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff8ac67e2d0000) has no exports 00000020:00000080:1.0:1783135628.418008:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf906 00000020:00000080:1.0:1783135628.418015:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac5430d4000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1783135628.418486:0:15269:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1783135628.418491:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783135628.418508:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1783135628.418514:0:15269:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135628.418516:0:15269:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783135628.418561:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135628.418570:0:15269:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783135628.418579:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf7cb 00000020:00000080:1.0:1783135628.418583:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67b3c6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1783135628.418588:0:15269:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1783135628.418591:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135628.418594:0:15269:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783135628.418596:0:15269:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff8ac66b588000) has no exports 00000020:00000080:1.0:1783135628.418600:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf7c4 00000020:00000080:1.0:1783135628.418603:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac542770000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783135628.419064:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac543928000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1783135628.419074:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5430d4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783135628.419080:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac54392b800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1783135628.419099:0:8:0:(genops.c:906:class_export_put()) final put ffff8ac5430d2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783135628.419101:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5430d2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1783135628.419105:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783135628.419192:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b3c6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783135628.419197:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac542770000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1783135628.420421:0:15269:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1783135628.420435:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783135628.420439:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1783135628.420445:0:15269:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135628.420447:0:15269:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135628.420488:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135628.420499:0:15269:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1783135628.420518:0:15269:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783135628.420525:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf627 00000020:00000080:2.0:1783135628.420532:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67c2e6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1783135628.420538:0:15269:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1783135628.420542:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135628.420546:0:15269:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783135628.420549:0:15269:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8ac67c16b380) has no exports 00000020:00000080:2.0:1783135628.420556:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf620 00000020:00000080:2.0:1783135628.420559:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67c163800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783135628.427398:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac542771800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783135628.427422:0:8:0:(genops.c:906:class_export_put()) final put ffff8ac542770800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783135628.427426:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac542770800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1783135628.427434:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783135628.427511:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c2e6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783135628.427516:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c163800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1783135628.428165:0:15269:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1783135628.428171:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135628.428175:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1783135628.428182:0:15269:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783135628.428238:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135628.428249:0:15269:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783135628.428281:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135628.428283:0:15269:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783135628.428287:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67b3c4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783135628.428289:0:15269:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b3c4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1783135628.428294:0:15269:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783135628.428422:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf60b 00000020:00000080:3.0:1783135628.428428:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67b4c7000/lustre-MDD0001_UUID 00000020:01000000:3.0:1783135628.428433:0:15269:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1783135628.428436:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135628.428440:0:15269:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783135628.428444:0:15269:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff8ac67b4b99c0) has no exports 00000020:00000080:3.0:1783135628.428471:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135628.428474:0:15269:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1783135628.428477:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf612 00000020:00000080:3.0:1783135628.428481:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67b4c2000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1783135628.428489:0:15269:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac6743ed800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1783135628.428492:0:15269:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac6743ed800 2 00000020:01000004:3.0:1783135628.428495:0:15269:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ac6743ed800 from lustre-MDT0001 00000020:00000080:3.0:1783135628.428514:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135628.428530:0:15269:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1783135628.428533:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67b4c5000/lustre-MDT0001_UUID 00000020:00000080:3.0:1783135628.428535:0:15269:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b4c5000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1783135628.428541:0:15269:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1783135628.428574:0:15269:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1783135628.428578:0:15269:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1783135628.428581:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135628.428584:0:15269:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783135628.428591:0:15269:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8ac658084800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135628.428596:0:15269:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff8ac66b58cd40) has exports, disconnecting them 00000020:00080000:3.0:1783135628.428600:0:15269:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8ac658084800), last request at 1783135347 00000020:00000080:3.0:1783135628.428603:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf666 00000020:00080000:3.0:1783135628.428614:0:15269:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac658084800): rc 0 00000020:00000080:3.0:1783135628.428617:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac658084800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783135628.429195:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c164000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1783135628.429206:0:8:0:(genops.c:906:class_export_put()) final put ffff8ac67c164800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783135628.429209:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c164800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1783135628.429217:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783135628.429351:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b4c7000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1783135628.429355:0:8:0:(genops.c:906:class_export_put()) final put ffff8ac67b4c3800/lustre-MDD0001_UUID 00000020:00000080:1.0:1783135628.429357:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b4c3800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1783135628.429360:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1783135628.429531:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b4c2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783135628.429536:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac658084800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1783135628.472238:0:15269:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1783135628.472248:0:15269:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135628.472252:0:15269:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135628.472259:0:15269:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135628.472430:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135628.472441:0:15269:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1783135628.472449:0:15269:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac6743ed800 1 00000020:00000080:2.0:1783135628.472456:0:15269:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf5a2 00000020:00000080:2.0:1783135628.472464:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac67b3c7000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1783135628.472470:0:15269:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1783135628.472475:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135628.472479:0:15269:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783135628.472482:0:15269:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8ac6608e3380) has no exports 00000020:00000080:1.0:1783135628.474384:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac64346e800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1783135628.474401:0:8:0:(genops.c:906:class_export_put()) final put ffff8ac67b1bb000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1783135628.474405:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b1bb000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1783135628.474418:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1783135628.474500:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b3c7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1783135628.513047:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135628.513194:0:15269:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1783135628.513200:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac6743ec000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1783135628.513206:0:15269:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac6743ec000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1783135628.513212:0:15269:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1783135628.513350:0:15269:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ac6743e9000 00000020:01000000:1.0:1783135628.513374:0:15269:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1783135628.513378:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135628.513383:0:15269:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783135628.513386:0:15269:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8ac6608e19c0) has no exports 00000100:00100000:2.0:1783135628.513947:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8ac64a0bf600:6522] 0 exiting: rc = 1 00000100:00100000:1.0:1783135628.514136:0:8461:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8ac542451200:8461] 3 exiting: rc = 0 00000100:00100000:1.0:1783135628.514356:0:6524:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ac660719600:6524] 2 exiting: rc = 0 00000100:00100000:2.0:1783135628.515903:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8ac6586c1c00:6523] 1 exiting: rc = 0 00000100:00100000:2.0:1783135628.521641:0:13464:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8ac67b0fd200:13464] 4 exiting: rc = 0 00000100:00100000:1.0:1783135628.524080:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524186:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524195:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524204:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524211:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524219:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524227:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524235:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524242:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524253:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524277:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524347:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524356:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524362:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524368:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524374:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524379:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524385:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524390:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524394:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524399:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524404:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524409:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524431:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524438:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524447:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524453:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524461:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524469:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524478:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524486:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524503:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524509:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524514:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524519:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524533:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524539:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524544:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524549:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524555:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524559:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524565:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524570:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524576:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524582:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524587:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524592:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524598:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524603:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524609:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524614:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524619:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524623:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524629:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524636:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524642:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524647:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524653:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524665:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524672:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524680:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524687:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524695:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.524703:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.536266:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8ac64a0bf400:6525] 0 exiting: rc = 1 00000100:00100000:2.0:1783135628.536529:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8ac64a0be000:6526] 1 exiting: rc = 0 00000100:00100000:3.0:1783135628.537563:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537573:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537579:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537586:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537591:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537597:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537603:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537609:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537615:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537620:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537626:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537632:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537640:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537645:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537649:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537654:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537659:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537675:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537680:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537685:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537691:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537696:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537702:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537707:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537712:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537718:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537723:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537729:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537734:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537738:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537743:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537748:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537752:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537757:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537762:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537778:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537785:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537790:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537794:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537800:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537805:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537810:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537815:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537819:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537825:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537830:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537836:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537842:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537847:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537852:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537857:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537862:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537875:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537880:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537885:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537890:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537895:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537901:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537906:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537911:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537916:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537922:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537927:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.537932:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.539506:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8ac65801e000:6528] 1 exiting: rc = 0 00000100:00100000:1.0:1783135628.539623:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8ac64a0bf800:6527] 0 exiting: rc = 1 00000100:00100000:2.0:1783135628.540908:0:13344:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8ac543b4d200:13344] 2 exiting: rc = 0 00000100:00100000:3.0:1783135628.541421:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541432:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541440:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541447:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541466:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541472:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541479:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541488:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541506:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541512:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541518:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541525:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541530:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541536:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541541:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541547:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541567:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541574:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541580:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541585:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541591:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541596:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541601:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541623:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541630:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541636:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541642:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541648:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541669:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541677:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541682:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541689:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541696:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541701:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541707:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541713:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541720:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541725:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541731:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541738:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541757:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541764:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541780:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541786:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541792:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541799:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541805:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541811:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541817:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541822:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541827:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541844:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541865:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541873:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541879:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541885:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541891:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541897:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541910:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541915:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541922:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541927:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541933:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.541939:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.574564:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8ac65801ec00:6530] 1 exiting: rc = 0 00000100:00100000:2.0:1783135628.574733:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8ac65801f600:6529] 0 exiting: rc = 1 00000100:00100000:2.0:1783135628.574823:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574831:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574837:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574842:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574850:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574856:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574861:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574867:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574872:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574878:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574884:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574889:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574895:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574901:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574906:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574912:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574917:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574922:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574927:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574933:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574938:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574943:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574948:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574953:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574959:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574963:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574969:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574975:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574980:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574986:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574992:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.574997:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575001:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575026:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575032:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575038:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575043:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575047:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575053:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575058:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575062:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575068:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575074:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575079:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575084:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575116:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575122:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575126:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575132:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575137:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575142:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575147:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575152:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575157:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575162:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575168:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575173:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575178:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575183:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575188:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575194:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575200:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575206:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.575211:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.575753:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8ac65801fc00:6531] 0 exiting: rc = 1 00000100:00100000:1.0:1783135628.575980:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8ac65801ee00:6532] 1 exiting: rc = 0 00000100:00100000:2.0:1783135628.576080:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576113:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576120:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576124:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576140:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576145:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576150:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576156:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576163:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576167:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576172:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576177:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576182:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576188:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576195:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576200:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576205:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576210:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576215:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576220:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576225:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576231:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576236:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576241:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576246:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576250:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576254:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576258:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576263:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576268:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576273:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576278:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576283:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576288:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576293:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576298:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576303:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576408:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576415:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576429:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576433:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576437:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576442:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576447:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576452:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576456:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576461:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576466:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576470:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576476:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576481:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576486:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576491:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576495:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576513:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576520:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576525:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576530:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576535:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576541:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576545:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576551:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576557:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.576563:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135628.581074:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8ac65801f000:6534] 1 exiting: rc = 0 00000100:00100000:3.0:1783135628.582319:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8ac660718600:6533] 0 exiting: rc = 1 00000100:00100000:2.0:1783135628.582812:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582821:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582826:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582832:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582838:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582843:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582848:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582854:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582859:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582864:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582884:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582890:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582895:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582901:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582905:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582911:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582916:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582921:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582926:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582931:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582936:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582940:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582945:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582951:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582956:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582961:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582965:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582969:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582974:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582979:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582984:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582989:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582994:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.582999:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583005:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583010:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583015:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583020:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583026:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583030:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583035:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583040:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583044:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583049:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583054:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583066:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583071:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583077:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583082:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583122:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583129:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583133:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583139:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583145:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583149:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583154:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583159:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583163:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583168:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583174:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583179:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583184:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583189:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.583194:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135628.583874:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8ac672e0e400:6536] 1 exiting: rc = 0 00000100:00100000:1.0:1783135628.584170:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8ac672e0ea00:6535] 0 exiting: rc = 1 00000100:00100000:1.0:1783135628.584350:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8ac64343f200:6537] 2 exiting: rc = 0 00000100:00100000:2.0:1783135628.584817:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584825:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584831:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584836:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584842:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584847:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584853:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584859:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584882:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584891:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584896:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584901:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584906:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584913:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584919:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584926:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584949:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584955:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584960:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584966:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584971:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584976:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584981:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584987:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584992:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.584997:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585003:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585007:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585012:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585018:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585023:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585029:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585048:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585054:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585060:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585067:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585074:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585079:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585114:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585122:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585127:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585132:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585138:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585143:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585148:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585154:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585159:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585164:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585169:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585174:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585179:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585192:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585197:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585202:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585207:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585212:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585231:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585237:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585243:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585249:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585254:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585259:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585265:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135628.585270:0:15269:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783135628.593695:0:15269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135628.593711:0:15269:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1783135628.593718:0:15269:0:(genops.c:906:class_export_put()) final put ffff8ac643828800/MDS_uuid 00000020:00000080:2.0:1783135628.593723:0:15269:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac643828800/MDS_uuid for MDS 00000020:01000000:2.0:1783135628.593729:0:15269:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1783135628.595009:0:15269:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1783135629.166381:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783135629.679229:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135629.679239:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135629.679242:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135629.679246:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783135629.679250:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135629.679259:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1783135629.679265:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783135629.679274:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ac5424bf000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135629.679313:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67f84e680 x1869752809201920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135629.679359:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135629.679362:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783135629.679364:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6f8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135629.679367:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 528 00000100:00080000:3.0:1783135629.679370:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783135629.679373:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ac67c6f8800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135629.679456:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67f84f800 x1869752809202176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135629.679585:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809202304:0@lo:400:kworker.0 00000400:00000100:3.0:1783135629.679708:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809202304 offset 0 length 224: 4 00000100:00100000:3.0:1783135629.679770:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135629.679777:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809202048:0@lo:400:kworker.0 00000400:00000100:3.0:1783135629.679794:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809202048 offset 0 length 224: 4 00000100:00100000:0.0:1783135629.679956:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869752809201920:0@lo:38:kworker.0 00000400:00000100:0.0:1783135629.679981:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809201920 offset 0 length 520: 4 00000100:00100000:0.0:1783135629.680010:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869752809202176:0@lo:38:kworker.0 00000400:00000100:0.0:1783135629.680025:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809202176 offset 0 length 520: 4 00010000:00010000:1.0:1783135630.191872:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135631.216474:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135632.245239:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135632.689736:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135632.689747:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135632.689750:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135632.689754:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783135632.689842:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809202432:0@lo:400:kworker.0 00000400:00000100:3.0:1783135632.689901:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809202432 offset 0 length 224: 4 00000100:00080000:1.0:1783135632.689968:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135632.689973:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135632.690010:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809202560:0@lo:400:kworker.0 00000400:00000100:2.0:1783135632.690041:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809202560 offset 0 length 224: 4 00000020:01000004:3.0:1783135633.112205:0:15470:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783135633.126232:0:15470:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1783135633.126289:0:15470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135633.126305:0:15470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135633.126312:0:15470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135633.126319:0:15470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135633.126341:0:15470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783135633.126347:0:15470:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783135633.126374:0:15470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135633.126388:0:15470:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84e680 x1869752809201920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135649 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135633.126425:0:15470:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783135633.126445:0:15470:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783135633.126452:0:15470:0:(import.c:65:import_set_state_nolock()) ffff8ac5424bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1783135633.126456:0:15470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135633.126461:0:15470:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84e680 x1869752809201920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135649 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135633.126468:0:15470:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783135633.126471:0:15470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00010000:00010000:1.0:1783135633.126858:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135633.126866:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135633.126874:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e200 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135633.126878:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135633.126899:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135633.126906:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135633.126912:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135633.126915:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783135633.126917:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783135633.126933:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ac64b2ce000 00010000:00010000:1.0:1783135633.126938:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135633.126944:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e200/0xf7de4ef628edf9df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edf9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135633.126955:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135633.126957:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135633.126959:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135633.128840:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869752809201920:0@lo:38:kworker.0 00000100:00080000:3.0:1783135633.132253:0:15470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783135633.132271:0:15470:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84d500 x1869752809202048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135645 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135633.132351:0:15470:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67b3b3480 x1869752809202432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135648 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135633.132371:0:15470:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783135633.132377:0:15470:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783135633.132403:0:15470:0:(import.c:65:import_set_state_nolock()) ffff8ac5424b8000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783135633.132490:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809202432:0@lo:400:kworker.0 00000100:00100000:0.0:1783135633.134134:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809202048:0@lo:400:kworker.0 00000100:00100000:2.0:1783135633.136055:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869752809202688:0@lo:39:umount.0 00000400:00000100:2.0:1783135633.136223:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809202688 offset 0 length 224: 4 00010000:00010000:1.0:1783135633.264074:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135634.287609:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783135634.288231:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783135634.288237:0:8431:0:(genops.c:906:class_export_put()) final put ffff8ac67c6f9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783135634.288332:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c6f9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783135634.288395:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c6ff800 for lustre-OST0000 00000001:00100000:3.0:1783135634.289403:0:9520:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783135634.289410:0:9520:0:(genops.c:906:class_export_put()) final put ffff8ac67c6fb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783135634.289480:0:13713:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c6fb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783135634.289523:0:13713:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c6fa800 for lustre-OST0001 00000100:00080000:3.0:1783135634.734274:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135634.734287:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135634.734290:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135634.734293:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135634.734458:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135634.734480:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809202816:0@lo:400:kworker.0 00000400:00000100:0.0:1783135634.734559:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809202816 offset 0 length 224: 4 00010000:00010000:0.0:1783135635.311040:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135636.335344:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135637.358571:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135638.257227:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135628/real 1783135628] req@ffff8ac5438b1f80 x1869752809201792/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135638 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135638.257289:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac5438b1f80 x1869752809201792/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135638 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135638.257309:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2ce000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135638.257337:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1783135638.257342:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3645:1869752809201792:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1783135638.257438:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135638.257450:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783135638.257452:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2ce000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135638.257457:0:8:0:(import.c:512:import_select_connection()) MGC192.168.204.106@tcp: connect to NID 0@lo last attempt 532 00000100:00080000:3.0:1783135638.257463:0:8:0:(import.c:591:import_select_connection()) MGC192.168.204.106@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783135638.257469:0:8:0:(import.c:626:import_select_connection()) MGC192.168.204.106@tcp: import ffff8ac64b2ce000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135638.257501:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67f84c700 x1869752809202944/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135638.257544:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135638.257548:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135638.257714:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809203072:0@lo:400:kworker.0 00000400:00000100:0.0:1783135638.257762:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809203072 offset 0 length 224: 4 00000100:00100000:2.0:1783135638.257765:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3645:1869752809202944:0@lo:250:kworker.0 00000400:00000100:2.0:1783135638.257785:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752809202944 offset 0 length 520: 4 00010000:00010000:0.0:1783135638.383001:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135639.410405:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135640.431289:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135641.454452:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135642.479625:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135643.374334:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135633/real 1783135633] req@ffff8ac67f84e300 x1869752809202688/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135643 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135643.374368:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac67f84e300 x1869752809202688/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135643 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135643.374390:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac5424b8000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783135643.374415:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869752809202688:0@lo:39:umount.0 00000100:00080000:3.0:1783135643.374525:0:15470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1783135643.374530:0:15470:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783135643.374534:0:15470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783135643.375673:0:15470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135643.375697:0:15470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135643.375707:0:15470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135643.375716:0:15470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135643.375742:0:15470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135643.375756:0:15470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135643.375797:0:15470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135643.375910:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135643.375925:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135643.375933:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f800 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135643.375942:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135643.375952:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135643.375990:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135643.375996:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783135643.375998:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1783135643.376016:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ac64b2ce000 00010000:00010000:0.0:1783135643.376020:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135643.376033:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628edf9ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edf9f4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135643.376057:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135643.376059:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135643.376061:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135643.376364:0:15470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135643.376371:0:15470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135643.376427:0:15470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783135643.376432:0:15470:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1783135643.376437:0:15470:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1783135643.376462:0:15470:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1783135643.376467:0:15470:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1783135643.376472:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135643.376477:0:15470:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783135643.376481:0:15470:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8ac541dc19c0) has no exports 00000020:00080000:3.0:1783135643.376513:0:15470:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8ac541dc19c0) has no exports 00010000:00010000:1.0:1783135643.385500:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135643.385518:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135643.385532:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135643.385557:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135643.385570:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135643.385578:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135643.385584:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783135643.385588:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783135643.385591:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783135643.385610:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ac64b2ce000 00010000:00010000:1.0:1783135643.385615:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135643.385622:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67e20e600/0xf7de4ef628edfc63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edfc6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135643.385637:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135643.385639:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135643.385640:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1783135643.385988:0:15470:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ac541e033c0 - data ffff8ac66af1d510/ffff8ac67533c400 00000020:01000000:3.0:1783135643.386281:0:15470:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ac67c2c10c0 - data ffff8ac66ad45bd0/ffff8ac67c723000 00100000:10000000:3.0:1783135643.408448:0:15470:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783135643.424478:0:15470:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf73f 00000020:00000080:1.0:1783135643.424504:0:15470:0:(genops.c:906:class_export_put()) final put ffff8ac67b3c3800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783135643.424727:0:15470:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac67c2fd800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783135643.424732:0:15470:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac67c2fd800 2 00000020:01000004:1.0:1783135643.424735:0:15470:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ac67c2fd800 from lustre-OST0000 00000020:00000080:1.0:1783135643.424765:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135643.424775:0:15470:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783135643.424778:0:15470:0:(genops.c:906:class_export_put()) final put ffff8ac67b3c7800/lustre-OST0000_UUID 00000020:00000080:1.0:1783135643.424781:0:15470:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b3c7800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783135643.424787:0:15470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783135643.424863:0:15470:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783135643.424867:0:15470:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783135643.424870:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135643.424874:0:15470:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783135643.424880:0:15470:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ac5424ba800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783135643.424886:0:15470:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff8ac67c16cd40) has exports, disconnecting them 00000020:00080000:1.0:1783135643.424890:0:15470:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ac5424ba800), last request at 1783135369 00000020:00000080:1.0:1783135643.424895:0:15470:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf769 00000020:00080000:1.0:1783135643.424905:0:15470:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac5424ba800): rc 0 00000020:00000080:1.0:1783135643.424909:0:15470:0:(genops.c:906:class_export_put()) final put ffff8ac5424ba800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783135643.429003:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b3c3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783135643.431840:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5424ba800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783135643.434239:0:15470:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783135643.434252:0:15470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135643.434256:0:15470:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783135643.434263:0:15470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783135643.434436:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135643.434445:0:15470:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1783135643.434452:0:15470:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783135643.434457:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135643.434461:0:15470:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783135643.434470:0:15470:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8ac5424b9800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135643.434477:0:15470:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff8ac67c168000) has exports, disconnecting them 00000020:00080000:0.0:1783135643.434481:0:15470:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8ac5424b9800), last request at 1783135369 00000020:00000080:0.0:1783135643.434486:0:15470:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf77e 00000020:00080000:0.0:1783135643.434533:0:15470:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac5424b9800): rc 0 00000020:00000080:0.0:1783135643.434540:0:15470:0:(genops.c:906:class_export_put()) final put ffff8ac5424b9800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1783135643.435727:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac5424bf000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783135643.435751:0:468:0:(genops.c:906:class_export_put()) final put ffff8ac67c160000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1783135643.435755:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c160000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1783135643.435762:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1783135643.435846:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5424b9800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1783135643.442261:0:15470:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783135643.442271:0:15470:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783135643.442303:0:15470:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135643.442310:0:15470:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135643.442344:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac5424b8000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1783135643.442508:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135643.442530:0:15470:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1783135643.442538:0:15470:0:(genops.c:906:class_export_put()) final put ffff8ac5424bb000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1783135643.442543:0:15470:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5424bb000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1783135643.442550:0:15470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1783135643.442641:0:15470:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac67c2fd800 1 00000020:00000080:2.0:1783135643.442648:0:15470:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf707 00000020:00000080:2.0:1783135643.442655:0:15470:0:(genops.c:906:class_export_put()) final put ffff8ac67b4c0000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1783135643.442664:0:15470:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1783135643.442673:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b4c0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1783135643.442682:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135643.442687:0:15470:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783135643.442691:0:15470:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff8ac67c1699c0) has no exports 00000020:00000080:2.0:1783135643.508894:0:15470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135643.508907:0:15470:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1783135643.508913:0:15470:0:(genops.c:906:class_export_put()) final put ffff8ac67c2f9000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1783135643.508918:0:15470:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c2f9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1783135643.508929:0:15470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000100:00080000:1.0:1783135643.509432:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135643.509438:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135643.509440:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135643.509443:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135643.509541:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809203200:0@lo:400:kworker.0 00000400:00000100:0.0:1783135643.509593:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809203200 offset 0 length 224: 4 00000020:01000004:2.0:1783135643.510408:0:15470:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ac67c2fb800 00000020:02000400:2.0:1783135643.510478:0:15470:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783135643.661599:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135644.726035:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1783135645.422298:0:3649:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135629/real 1783135629] req@ffff8ac67f84dc00 x1869752809202304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135645 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135645.459608:0:3649:0:(client.c:2533:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8ac67f84dc00 x1869752809202304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135645 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135645.459624:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8ac67c165000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783135645.459627:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783135645.473957:0:3649:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1783135645.474023:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135645.474030:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135645.474033:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135645.474054:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135645.474057:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135645.474060:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783135645.474064:0:468:0:(import.c:65:import_set_state_nolock()) ffff8ac67c165000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135645.474074:0:468:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 301 00000100:00080000:1.0:1783135645.474121:0:468:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ac67c165000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135645.474168:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67b3b1c00 x1869752809203328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135645.474217:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809202304:0@lo:400:kworker.0 00000100:00100000:3.0:1783135645.476849:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869752809203328:0@lo:38:kworker.0 00000400:00000100:3.0:1783135645.476943:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752809203328 offset 0 length 520: 4 00010000:00010000:3.0:1783135645.744299:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135646.766391:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135647.800006:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783135648.126373:0:15672:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783135648.148217:0:15672:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783135648.148397:0:15672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.148423:0:15672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.148431:0:15672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.148510:0:15672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.148537:0:15672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783135648.148543:0:15672:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783135648.148571:0:15672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135648.148620:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84f800 x1869752809202176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135649 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.148642:0:15672:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783135648.148648:0:15672:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783135648.148653:0:15672:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783135648.148658:0:15672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135648.148662:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84f800 x1869752809202176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135649 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.148684:0:15672:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783135648.148687:0:15672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00010000:00010000:1.0:1783135648.148795:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135648.148802:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135648.148810:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527800 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135648.148814:0:8453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135648.148824:0:8453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135648.148831:0:8453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135648.148837:0:8453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135648.148840:0:8453:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783135648.148848:0:8453:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783135648.148863:0:8453:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ac64b2ce000 00010000:00010000:1.0:1783135648.148868:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135648.148875:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c527800/0xf7de4ef628edf9c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edf9ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135648.148887:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135648.148888:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135648.148890:0:8453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135648.149046:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869752809202176:0@lo:38:kworker.0 00000100:00080000:0.0:1783135648.153744:0:15672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783135648.153766:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67b3b0380 x1869752809202560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135648 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.153796:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84ed80 x1869752809202816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135650 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.153916:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84d500 x1869752809203072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135654 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.153927:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67b3b3480 x1869752809203200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135659 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.153952:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67b3b1c00 x1869752809203328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135655 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.153968:0:15672:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783135648.153974:0:15672:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783135648.153980:0:15672:0:(import.c:65:import_set_state_nolock()) ffff8ac67c165000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783135648.153985:0:15672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783135648.153988:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67b3b0380 x1869752809202560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135648 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.153997:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84ed80 x1869752809202816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135650 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135648.154074:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809203200:0@lo:400:kworker.0 00000100:00100000:1.0:1783135648.154107:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1869752809202560:0@lo:400:kworker.0 00000100:00100000:2.0:1783135648.154148:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809202816:0@lo:400:kworker.0 00000100:00100000:0.0:1783135648.154183:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84d500 x1869752809203072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135654 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.154191:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67b3b3480 x1869752809203200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135659 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.154199:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67b3b1c00 x1869752809203328/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135655 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135648.154220:0:15672:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783135648.155992:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1869752809203072:0@lo:400:kworker.0 00000100:00100000:2.0:1783135648.156023:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869752809203328:0@lo:38:kworker.0 00000100:00100000:0.0:1783135648.156076:0:15672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783135648.157810:0:15672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.157831:0:15672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.157839:0:15672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.157847:0:15672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.157874:0:15672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135648.157881:0:15672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.157888:0:15672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.157895:0:15672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.157901:0:15672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135648.157917:0:15672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783135648.157922:0:15672:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1783135648.157964:0:15672:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1783135648.157968:0:15672:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1783135648.157972:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135648.157977:0:15672:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783135648.157981:0:15672:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8ac658010000) has no exports 00000020:00080000:0.0:1783135648.158003:0:15672:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff8ac658010000) has no exports 00010000:00010000:3.0:1783135648.158112:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135648.158121:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135648.158138:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526c00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135648.158144:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135648.158153:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135648.158160:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135648.158165:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135648.158168:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1783135648.158171:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1783135648.158185:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ac64b2ce000 00010000:00010000:3.0:1783135648.158190:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135648.158197:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628edf9d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edf9d8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135648.159126:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135648.159137:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135648.159146:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135648.159149:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135648.159156:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135648.159163:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135648.159167:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783135648.159170:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783135648.159172:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783135648.159181:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ac64b2ce000 00010000:00010000:1.0:1783135648.159185:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135648.159200:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628edfc55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edfc5c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135648.159213:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135648.159215:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135648.159216:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135648.162184:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135648.162214:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135648.162217:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783135648.163622:0:15672:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ac5438566c0 - data ffff8ac5420e8000/ffff8ac543065c00 00000020:01000000:0.0:1783135648.163789:0:15672:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8ac67c2c1660 - data ffff8ac66aefad80/ffff8ac543772800 00100000:10000000:0.0:1783135648.176924:0:15672:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783135648.186984:0:15672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf865 00000020:00000080:3.0:1783135648.186998:0:15672:0:(genops.c:906:class_export_put()) final put ffff8ac67e2dc000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1783135648.187025:0:15672:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac67e2d9800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1783135648.187029:0:15672:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac67e2d9800 2 00000020:01000004:3.0:1783135648.187033:0:15672:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ac67e2d9800 from lustre-OST0001 00000020:00000080:3.0:1783135648.187066:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135648.187160:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67e2dc000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1783135648.187506:0:15672:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1783135648.187511:0:15672:0:(genops.c:906:class_export_put()) final put ffff8ac67c6f8000/lustre-OST0001_UUID 00000020:00000080:3.0:1783135648.187514:0:15672:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c6f8000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1783135648.187537:0:15672:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1783135648.187721:0:15672:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import dfae7aea-4aeb-4043-b6ee-9086d4d5ab49->MGS 00010000:00010000:3.0:1783135648.187740:0:15672:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac640031a00/0xf7de4ef628edf5be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edf5c5 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135648.187753:0:15672:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac640031a00/0xf7de4ef628edf5be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edf5c5 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135648.187760:0:15672:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1783135648.187762:0:15672:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1783135648.187766:0:15672:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1783135648.187780:0:15672:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ac64b2ce000 00010000:00010000:3.0:1783135648.187784:0:15672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac640031a00/0xf7de4ef628edf5be lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edf5c5 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135648.187800:0:15672:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628edfa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf7de4ef628edfa3a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135648.187806:0:15672:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628edfa33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf7de4ef628edfa3a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135648.187811:0:15672:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135648.187813:0:15672:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1783135648.187814:0:15672:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1783135648.187823:0:15672:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ac64b2ce000 00010000:00010000:3.0:1783135648.187826:0:15672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628edfa33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf7de4ef628edfa3a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783135648.187843:0:15672:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2ce000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1783135648.187847:0:15672:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783135648.187849:0:15672:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783135648.187857:0:15672:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783135648.187861:0:15672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783135648.187871:0:15672:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ac67f84c700 x1869752809202944/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783135653 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783135648.187938:0:15672:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783135648.187941:0:15672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:2.0:1783135648.188717:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dfae7aea-4aeb-4043-b6ee-9086d4d5ab49:3645:1869752809202944:0@lo:250:kworker.0 10000000:01000000:3.0:1783135648.188791:0:15672:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783135648.188800:0:15672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf4bb 00000020:00000080:3.0:1783135648.188807:0:15672:0:(genops.c:906:class_export_put()) final put ffff8ac64382a000/dfae7aea-4aeb-4043-b6ee-9086d4d5ab49 00000020:01000000:3.0:1783135648.188825:0:15672:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.106@tcp (flags='') 00000020:00000080:3.0:1783135648.188831:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135648.188837:0:15672:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.106@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135648.188841:0:15672:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8ac66b5899c0) has no exports 00000020:00000080:0.0:1783135648.188890:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac64382a000/dfae7aea-4aeb-4043-b6ee-9086d4d5ab49 for MGC192.168.204.106@tcp 10000000:01000000:2.0:1783135648.188933:0:6519:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1783135648.189776:0:15672:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.106@tcp: client import never connected 00000100:00080000:3.0:1783135648.189782:0:15672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1783135648.189786:0:15672:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783135648.189789:0:15672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1783135648.189792:0:15672:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783135648.189885:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135648.189894:0:15672:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.106@tcp (uuid dfae7aea-4aeb-4043-b6ee-9086d4d5ab49) 00000020:01000000:3.0:1783135648.189902:0:15672:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783135648.189906:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135648.189911:0:15672:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783135648.189917:0:15672:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8ac67c6fa000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135648.189922:0:15672:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff8ac54359cd40) has exports, disconnecting them 00000020:00080000:3.0:1783135648.189927:0:15672:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8ac67c6fa000), last request at 1783135398 00000020:00000080:3.0:1783135648.189932:0:15672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf88f 00000020:00080000:3.0:1783135648.189947:0:15672:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac67c6fa000): rc 0 00000020:00000080:3.0:1783135648.189952:0:15672:0:(genops.c:906:class_export_put()) final put ffff8ac67c6fa000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783135648.190119:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac64b2ce000 for MGC192.168.204.106@tcp 00000020:00000080:0.0:1783135648.190129:0:468:0:(genops.c:906:class_export_put()) final put ffff8ac646dbd800/dfae7aea-4aeb-4043-b6ee-9086d4d5ab49 00000020:00000080:0.0:1783135648.190132:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac646dbd800/dfae7aea-4aeb-4043-b6ee-9086d4d5ab49 for MGC192.168.204.106@tcp 00000020:01000000:0.0:1783135648.190140:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.106@tcp (dfae7aea-4aeb-4043-b6ee-9086d4d5ab49) 00000020:00000080:0.0:1783135648.192390:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c6fa000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783135648.194147:0:15672:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783135648.194157:0:15672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135648.194162:0:15672:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135648.194169:0:15672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135648.194320:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135648.194329:0:15672:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1783135648.194335:0:15672:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783135648.194339:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135648.194343:0:15672:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783135648.194351:0:15672:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8ac67c2fe800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783135648.194357:0:15672:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff8ac658013380) has exports, disconnecting them 00000020:00080000:2.0:1783135648.194361:0:15672:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8ac67c2fe800), last request at 1783135398 00000020:00000080:2.0:1783135648.194365:0:15672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf8a4 00000020:00080000:2.0:1783135648.194382:0:15672:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ac67c2fe800): rc 0 00000020:00000080:2.0:1783135648.194388:0:15672:0:(genops.c:906:class_export_put()) final put ffff8ac67c2fe800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1783135648.195065:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c6f8800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1783135648.195075:0:468:0:(genops.c:906:class_export_put()) final put ffff8ac67c5ee000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1783135648.195078:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c5ee000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1783135648.195085:0:468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1783135648.195166:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c2fe800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1783135648.210188:0:15672:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783135648.210197:0:15672:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783135648.210202:0:15672:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783135648.210210:0:15672:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783135648.210247:0:468:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8ac67c165000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1783135648.220270:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1783135648.220750:0:8453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1783135648.220949:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1783135648.221635:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1783135648.221898:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ac672e85e00:6506] 1 exiting: rc = 0 00000100:00100000:3.0:1783135648.222029:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ac672e85400:6505] 0 exiting: rc = 1 00000100:00100000:0.0:1783135648.222254:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.222820:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8ac661885e00:6509] 2 exiting: rc = 0 00000100:00100000:2.0:1783135648.222897:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ac6581cb600:6507] 0 exiting: rc = 1 00000100:00100000:2.0:1783135648.222973:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ac64667ae00:6508] 1 exiting: rc = 0 00000100:00100000:2.0:1783135648.223057:0:10345:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8ac5437cae00:10345] 4 exiting: rc = 0 00000100:00100000:3.0:1783135648.223453:0:10344:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8ac543a0f600:10344] 3 exiting: rc = 0 00000100:00100000:1.0:1783135648.223850:0:10346:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_005: service thread [ffff8ac543973600:10346] 5 exiting: rc = 0 00000100:00100000:0.0:1783135648.225021:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225043:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225049:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225056:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225061:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225067:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225072:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225078:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225084:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225177:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225183:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225189:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225196:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225202:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225208:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225214:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225220:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225238:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.225245:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227415:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227422:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227427:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227440:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227446:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227451:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227457:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227462:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227467:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227472:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227477:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227482:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227487:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227494:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227500:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227505:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227511:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227538:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227544:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227550:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227556:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227561:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227566:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227571:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227576:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227580:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227585:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227590:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227594:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227599:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227604:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227609:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227615:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227620:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227625:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227630:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227636:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227640:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227645:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227651:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227656:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227661:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227666:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227671:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.227677:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783135648.229688:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135648.229704:0:15672:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1783135648.229710:0:15672:0:(genops.c:906:class_export_put()) final put ffff8ac5424be800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1783135648.229714:0:15672:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac5424be800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1783135648.229727:0:15672:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1783135648.229788:0:15672:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac67e2d9800 1 00000020:00000080:0.0:1783135648.229803:0:15672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf7de4ef628edf834 00000020:00000080:0.0:1783135648.229809:0:15672:0:(genops.c:906:class_export_put()) final put ffff8ac67c6fe000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1783135648.229880:0:15672:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1783135648.229885:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135648.229890:0:15672:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783135648.229894:0:15672:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff8ac67e2d4d40) has no exports 00000020:00000080:2.0:1783135648.235011:0:468:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67c6fe000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783135648.275912:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135648.275927:0:15672:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1783135648.275934:0:15672:0:(genops.c:906:class_export_put()) final put ffff8ac67e2df800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1783135648.275950:0:15672:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67e2df800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783135648.275962:0:15672:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1783135648.276953:0:15672:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8ac67e2dd800 00000020:01000000:2.0:1783135648.276990:0:15672:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1783135648.276997:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135648.277003:0:15672:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783135648.277007:0:15672:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8ac67b4bcd40) has no exports 00000020:00000080:2.0:1783135648.277070:0:15672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135648.277210:0:15672:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1783135648.277215:0:15672:0:(genops.c:906:class_export_put()) final put ffff8ac67b4c1800/OSS_uuid 00000020:00000080:2.0:1783135648.277218:0:15672:0:(genops.c:865:class_export_destroy()) destroying export ffff8ac67b4c1800/OSS_uuid for OSS 00000020:01000000:2.0:1783135648.277222:0:15672:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1783135648.277358:0:6518:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1783135648.277559:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8ac67b450600:8435] 0 exiting: rc = 1 00000100:00100000:3.0:1783135648.278018:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8ac67c4dc800:8438] 2 exiting: rc = 0 00000100:00100000:0.0:1783135648.278174:0:8620:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ac5424b0200:8620] 3 exiting: rc = 0 00000100:00100000:1.0:1783135648.279807:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8ac67b450200:8437] 1 exiting: rc = 0 00000100:00100000:2.0:1783135648.281870:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281890:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281908:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281914:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281920:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281925:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281930:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281935:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281940:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281945:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281977:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281983:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281989:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.281995:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282000:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282005:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282010:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282015:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282020:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282025:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282030:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282036:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282242:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282247:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282252:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282257:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282262:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282268:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282273:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282277:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282282:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282287:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282292:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282298:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282304:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282309:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282315:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282320:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282325:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282330:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282336:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282342:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282348:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282354:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282359:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282364:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282369:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282374:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282378:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282384:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282388:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282393:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282410:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282415:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282421:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282426:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282432:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282444:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282449:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282454:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282460:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282467:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282473:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.282548:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135648.284425:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8ac67b450c00:8440] 1 exiting: rc = 0 00000100:00100000:1.0:1783135648.284426:0:10560:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8ac54276e200:10560] 2 exiting: rc = 0 00000100:00100000:2.0:1783135648.284537:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8ac67c3e2800:8439] 0 exiting: rc = 1 00000100:00100000:0.0:1783135648.284605:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284619:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284627:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284634:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284640:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284645:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284651:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284656:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284661:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284667:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284672:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284677:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284683:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284793:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284814:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284823:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284828:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284832:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284837:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284843:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284849:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284854:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284859:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284864:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284868:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284873:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284895:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284900:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284906:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284912:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284917:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284923:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284928:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284933:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284938:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284943:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284948:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284954:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284959:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284964:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284970:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284975:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284980:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284985:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284990:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.284995:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285001:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285006:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285012:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285017:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285023:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285028:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285033:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285037:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285042:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285059:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285064:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285069:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285074:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285079:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285116:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285129:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285134:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.285145:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.286171:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8ac64343fc00:8442] 1 exiting: rc = 0 00000100:00100000:2.0:1783135648.287561:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8ac67c44e800:8443] 2 exiting: rc = 0 00000100:00100000:2.0:1783135648.287888:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8ac64343e000:8441] 0 exiting: rc = 1 00000100:00100000:0.0:1783135648.287990:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.287998:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288004:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288010:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288044:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288286:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288292:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288298:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288303:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288309:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288314:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288319:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288325:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288331:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288337:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288343:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288348:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288354:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288361:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288366:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288372:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288378:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288383:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288389:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288394:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288411:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288417:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288423:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288443:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288450:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288455:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288478:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288552:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288559:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288565:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288704:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288712:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288720:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288726:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288736:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288745:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288752:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288758:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288765:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288772:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288779:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288789:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288798:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288804:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288810:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288818:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288825:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288860:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288868:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288879:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288885:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288901:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288907:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288913:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288919:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288930:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288946:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288961:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.288978:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135648.297648:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8ac67c253400:8444] 0 exiting: rc = 1 00000100:00100000:1.0:1783135648.297745:0:8608:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff8ac541d8a600:8608] 2 exiting: rc = 0 00000100:00100000:3.0:1783135648.299111:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8ac67c252200:8445] 1 exiting: rc = 0 00000100:00100000:0.0:1783135648.306042:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306494:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306518:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306525:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306534:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306544:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306606:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306648:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306656:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306661:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306666:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306670:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306675:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306680:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306685:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306695:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306700:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306704:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.306709:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307656:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307680:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307685:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307690:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307697:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307702:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307707:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307712:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307717:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307723:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307727:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307732:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307736:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307741:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307745:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307750:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307756:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307760:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307783:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307789:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307795:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307800:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307805:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307811:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307816:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307821:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307835:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307843:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307848:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307855:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307862:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307867:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307873:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307884:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307891:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307897:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307902:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307907:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307911:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307916:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307922:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307927:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307932:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307936:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135648.307946:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.318686:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8ac6750d0400:8447] 1 exiting: rc = 0 00000100:00100000:2.0:1783135648.319021:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8ac67c253800:8446] 0 exiting: rc = 1 00000100:00100000:1.0:1783135648.319623:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319633:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319640:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319646:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319652:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319659:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319691:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319700:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319707:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319712:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319718:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319724:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319730:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319735:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319741:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319747:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319767:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319773:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319795:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319803:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319809:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319814:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319821:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319828:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319835:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319841:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319848:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319854:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319859:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319865:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319887:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319894:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319900:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319907:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319912:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319917:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319923:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319927:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319933:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319938:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319943:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319962:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319983:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319990:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.319995:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320000:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320005:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320011:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320017:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320022:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320028:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320041:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320047:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320065:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320509:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320520:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320526:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320531:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320537:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320542:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320547:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320553:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320558:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135648.320575:0:15672:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783135648.344120:0:15672:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1783135669.621622:0:16436:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1783135680.760071:0:17043:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783135680.760076:0:17043:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1783135680.760078:0:17043:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1783135680.760227:0:17043:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ac678352000 00000020:01000004:1.0:1783135680.760245:0:17043:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1783135680.760253:0:17043:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1783135680.760268:0:17043:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ac67e2d3380) 00000020:00000080:1.0:1783135680.760280:0:17043:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783135680.808611:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783135680.810654:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.815637:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.818136:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.818376:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.818552:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.818741:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.819295:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.819545:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.819734:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.820226:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.820452:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.820672:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.821057:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.821361:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.821549:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.821738:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.822120:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.822346:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.823040:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.824460:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.824693:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.825272:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.825548:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.825741:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.826122:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.826321:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.826506:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.826686:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.826887:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.827245:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.827446:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.827721:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.827927:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1783135680.828337:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783135680.828805:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.829122:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.829364:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783135680.829775:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.830182:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.830433:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.830615:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783135680.830841:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783135680.831136:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.831361:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783135680.831575:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783135680.831805:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783135680.832729:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.833346:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.833543:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.834060:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.834381:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1783135680.834601:0:17043:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1783135680.835411:0:17043:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783135680.835626:0:17043:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783135680.835634:0:17043:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135680.835646:0:17043:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628ee0a78 00000020:01000004:3.0:1783135680.835653:0:17043:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1783135680.835657:0:17043:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783135680.835662:0:17043:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ac678352000 from MGS 00000020:01000004:3.0:1783135680.835666:0:17043:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783135680.835675:0:17043:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ac658010000) 00000020:00000080:3.0:1783135680.835687:0:17043:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783135680.835747:0:17043:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac678352000 from MGS, refs=2 00080000:01000000:3.0:1783135680.835752:0:17043:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783135680.835757:0:17043:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628ee0a86 00000100:00100000:3.0:1783135680.835881:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783135680.836030:0:17043:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783135680.836038:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783135680.836646:0:17043:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783135680.836654:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783135680.837573:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135680.837735:0:17043:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783135680.837742:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783135680.843392:0:17043:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783135680.843417:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783135680.843754:0:17043:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783135680.843761:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783135680.844560:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135680.844563:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135680.844565:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135680.844831:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135680.844833:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135680.844835:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135680.845488:0:17043:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783135680.847558:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1783135680.855460:0:17043:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1783135680.858628:0:17055:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783135680.858744:0:17043:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783135680.858812:0:17043:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783135680.859893:0:17043:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783135680.860487:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135680.860657:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783135680.860665:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783135680.868498:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783135680.868516:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783135680.868735:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1783135680.868740:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1783135680.870115:0:17060:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1783135680.870376:0:17043:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783135680.870405:0:17043:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.106@tcp' 00000020:01000004:2.0:1783135680.870407:0:17043:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783135680.870447:0:17043:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.106@tcp (typ=mgc) 00000020:00000080:2.0:1783135680.870464:0:17043:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.106@tcp (ffff8ac543598000) 00000020:00000080:2.0:1783135680.870484:0:17043:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783135680.870581:0:17043:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac6743e8800@MGC192.168.204.106@tcp: add connection 192.168.204.106@tcp at head 00010000:00010000:2.0:1783135680.872137:0:17043:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.106@tcp-0 is initialized 00000040:01000000:2.0:1783135680.872148:0:17043:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 1 is initialized 10000000:01000000:2.0:1783135680.874171:0:17061:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783135680.874279:0:17043:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.106@tcp (uuid cd33be97-b4c1-460b-98a5-4a7a9daa67b8) 00000020:00000080:1.0:1783135680.874310:0:17043:0:(genops.c:1406:class_connect()) connect: client cd33be97-b4c1-460b-98a5-4a7a9daa67b8, cookie 0xf7de4ef628ee0a94 00000100:00080000:1.0:1783135680.874332:0:17043:0:(import.c:512:import_select_connection()) MGC192.168.204.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135680.874341:0:17043:0:(import.c:626:import_select_connection()) MGC192.168.204.106@tcp: import ffff8ac6743e8800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135680.874384:0:17043:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67b3b0380 x1869752809203456/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135680.874418:0:17043:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import cd33be97-b4c1-460b-98a5-4a7a9daa67b8->MGS 00000020:01000004:1.0:1783135680.874444:0:17043:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783135680.874470:0:17043:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783135680.874485:0:17043:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8ac67e2d4d40) 00000020:00000080:1.0:1783135680.874499:0:17043:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783135680.876360:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3645:1869752809203456:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783135680.876444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135680.885234:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809203456 00000100:00100000:2.0:1783135680.885249:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809203456 00000100:00100000:2.0:1783135680.885299:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135680.885308:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac64137d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1869752809203456:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783135680.885340:0:17056:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from cd33be97-b4c1-460b-98a5-4a7a9daa67b8@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:2.0:1783135680.885378:0:17056:0:(genops.c:1406:class_connect()) connect: client cd33be97-b4c1-460b-98a5-4a7a9daa67b8, cookie 0xf7de4ef628ee0aa2 00000100:00080000:2.0:1783135680.885517:0:17056:0:(import.c:65:import_set_state_nolock()) ffff8ac6743ec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135680.885603:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac64137d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+5:3645:x1869752809203456:12345-0@lo:250:mount.lustre.0 Request processed in 294us (9159us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135680.885610:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135680.886051:0:3645:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783135680.886060:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.106@tcp: connect to target with instance 0 00000100:00080000:2.0:1783135680.886068:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783135680.886073:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783135680.886076:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac6743e8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783135680.886079:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00100000:1.0:1783135680.889393:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135680.889571:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783135680.889578:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783135680.890598:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135680.890609:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00080000:2.0:1783135680.890927:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783135680.890943:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3645:1869752809203456:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783135680.891588:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783135680.891596:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783135680.892610:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135680.896257:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783135680.896267:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783135680.898766:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783135680.898777:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783135680.937605:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135680.938305:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783135680.938313:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783135680.939656:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783135680.939668:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1783135680.940520:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135680.940659:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783135680.940664:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783135680.941537:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783135680.941545:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783135680.946509:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135680.946690:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783135680.946696:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1783135680.947643:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783135680.947652:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783135680.948565:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135680.948945:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783135680.948951:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783135680.949678:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783135680.949687:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1783135680.981655:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135680.983396:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783135680.983407:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783135680.988689:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783135680.988705:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783135680.990538:0:17043:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783135680.990557:0:17043:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783135680.992048:0:17043:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783135680.992137:0:17043:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1783135680.992365:0:17043:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783135680.992489:0:17043:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783135680.992522:0:17043:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.106@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783135680.992527:0:17043:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783135680.992528:0:17043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135680.992530:0:17043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135680.992531:0:17043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135680.992532:0:17043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135680.992534:0:17043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135680.992535:0:17043:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135680.992536:0:17043:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135680.992538:0:17043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135680.992539:0:17043:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135680.992542:0:17043:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783135680.992545:0:17043:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135680.992549:0:17043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135680.992550:0:17043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135680.992551:0:17043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135680.992552:0:17043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135680.992553:0:17043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135680.992554:0:17043:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135680.992555:0:17043:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135680.992555:0:17043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135680.992556:0:17043:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135680.992586:0:17043:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783135680.992611:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809203584:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135680.992689:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135680.992747:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675352540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135680.992842:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809203584 00000100:00100000:1.0:1783135680.992850:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809203584 00000100:00100000:1.0:1783135680.992902:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135680.992911:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+5:17043:x1869752809203584:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783135680.992978:0:17059:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783135680.992981:0:17059:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783135680.992985:0:17059:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1783135680.993612:0:17080:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783135680.994312:0:17059:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1783135680.996008:0:17081:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1783135680.996016:0:17081:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1783135680.996020:0:17081:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1783135680.996022:0:17081:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1783135680.996732:0:17081:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1783135680.997361:0:17059:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783135680.997372:0:17059:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1783135681.000465:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+5:17043:x1869752809203584:12345-0@lo:253:mount.lustre.0 Request processed in 7546us (7767us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135681.000479:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135681.002021:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809203584:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783135681.002039:0:17043:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783135681.002042:0:17043:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783135681.002044:0:17043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783135681.002046:0:17043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135681.002047:0:17043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135681.002048:0:17043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135681.002050:0:17043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135681.002052:0:17043:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783135681.002053:0:17043:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783135681.002055:0:17043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135681.002056:0:17043:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783135681.002083:0:17043:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ac678352000 from lustre-MDT0000 10000000:01000000:0.0:1783135681.002139:0:17043:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783135681.002154:0:17043:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783135681.002159:0:17043:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ac543598000 10000000:01000000:0.0:1783135681.002165:0:17043:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783135681.002174:0:17043:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8ac543598000 from 1 10000000:01000000:0.0:1783135681.002177:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783135681.002239:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.002252:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.002262:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135681.002283:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809203712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135681.002340:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.002388:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:3.0:1783135681.002649:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809203712 00000100:00100000:3.0:1783135681.002656:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809203712 00000100:00100000:3.0:1783135681.002707:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135681.002717:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+5:17043:x1869752809203712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135681.002731:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135681.002747:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac682172a00/0xf7de4ef628ee0ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0aa9 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.002780:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac682172a00/0xf7de4ef628ee0ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0aa9 expref: 6 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.002803:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac682172a00/0xf7de4ef628ee0ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0aa9 expref: 6 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.002813:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac682172a00, rc 0) 00000100:00100000:3.0:1783135681.002869:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+6:17043:x1869752809203712:12345-0@lo:101:mount.lustre.0 Request processed in 152us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.002877:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135681.003080:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809203712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135681.003120:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.003131:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135681.003197:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809203840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135681.003223:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.003292:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135681.003466:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809203840 00000100:00100000:2.0:1783135681.003471:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809203840 00000100:00100000:2.0:1783135681.003506:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135681.003514:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+6:17043:x1869752809203840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135681.003606:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+6:17043:x1869752809203840:12345-0@lo:501:mount.lustre.0 Request processed in 92us (381us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135681.003614:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135681.003694:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809203840:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783135681.003723:0:17043:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783135681.003740:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.003751:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135681.003768:0:17043:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ac678352000 10000000:01000000:0.0:1783135681.003772:0:17043:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783135681.003776:0:17043:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ac678352000 10000000:01000000:0.0:1783135681.003778:0:17043:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783135681.003781:0:17043:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8ac678352000 from 1 10000000:01000000:0.0:1783135681.003793:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783135681.003813:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989200/0xf7de4ef628ee0ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.003830:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650989200/0xf7de4ef628ee0ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.003838:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650989200/0xf7de4ef628ee0ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135681.003853:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809203968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135681.003877:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.004044:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.004139:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809203968 00000100:00100000:1.0:1783135681.004213:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809203968 00000100:00100000:1.0:1783135681.004251:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135681.004260:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+6:17043:x1869752809203968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135681.004269:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135681.004282:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20e800/0xf7de4ef628ee0abe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0ab7 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135681.004300:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20e800/0xf7de4ef628ee0abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ab7 expref: 7 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135681.004310:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20e800/0xf7de4ef628ee0abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ab7 expref: 7 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135681.004326:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e800, rc 0) 00000100:00100000:1.0:1783135681.004369:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+7:17043:x1869752809203968:12345-0@lo:101:mount.lustre.0 Request processed in 111us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135681.004375:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135681.004482:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809203968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135681.004495:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650989200/0xf7de4ef628ee0ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0abe expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.004503:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650989200/0xf7de4ef628ee0ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0abe expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135681.004515:0:17043:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783135681.004531:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989200/0xf7de4ef628ee0ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0abe expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.004543:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650989200/0xf7de4ef628ee0ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0abe expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135681.004550:0:17043:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783135681.004553:0:17043:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783135681.004558:0:17043:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ac678352000 10000000:01000000:0.0:1783135681.004560:0:17043:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783135681.004563:0:17043:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783135681.004565:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783135681.004581:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628ee0ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.004587:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628ee0ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.004594:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628ee0ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135681.004607:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809204096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135681.004632:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.004660:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.004742:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809204096 00000100:00100000:1.0:1783135681.004747:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809204096 00000100:00100000:1.0:1783135681.004826:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135681.004834:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+7:17043:x1869752809204096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135681.004841:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135681.004850:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20ea00/0xf7de4ef628ee0acc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0ac5 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135681.004864:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20ea00/0xf7de4ef628ee0acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ac5 expref: 8 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135681.004872:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20ea00/0xf7de4ef628ee0acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ac5 expref: 8 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135681.004879:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20ea00, rc 0) 00000100:00100000:1.0:1783135681.004916:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+8:17043:x1869752809204096:12345-0@lo:101:mount.lustre.0 Request processed in 83us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135681.004921:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135681.006045:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809204096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135681.006069:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628ee0ac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0acc expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.006080:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628ee0ac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0acc expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135681.006213:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809204224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135681.006260:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.006295:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.006432:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809204224 00000100:00100000:1.0:1783135681.006447:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809204224 00000100:00100000:1.0:1783135681.006477:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135681.006485:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+8:17043:x1869752809204224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135681.006623:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+9:17043:x1869752809204224:12345-0@lo:501:mount.lustre.0 Request processed in 138us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135681.006637:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135681.006716:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809204224:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135681.006758:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809204352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135681.006803:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.006835:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.006934:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809204352 00000100:00100000:1.0:1783135681.006939:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809204352 00000100:00100000:1.0:1783135681.006956:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135681.006962:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+9:17043:x1869752809204352:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135681.008387:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+9:17043:x1869752809204352:12345-0@lo:503:mount.lustre.0 Request processed in 1419us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135681.008397:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135681.008674:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809204352:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135681.009436:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17082:1869752809204480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135681.009494:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.009533:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.009686:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809204480 00000100:00100000:1.0:1783135681.009693:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809204480 00000100:00100000:1.0:1783135681.009740:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135681.009749:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+9:17082:x1869752809204480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135681.010679:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+9:17082:x1869752809204480:12345-0@lo:502:llog_process_th.0 Request processed in 927us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135681.010689:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135681.010765:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17082:1869752809204480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135681.010808:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135681.010879:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135681.010882:0:17082:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783135681.010889:0:17082:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783135681.010892:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135681.010909:0:17082:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ac541dc4d40) 00000020:00000080:0.0:1783135681.010926:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783135681.010930:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783135681.011017:0:17082:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783135681.011025:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628ee0ada 00000020:00000080:0.0:1783135681.011376:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783135681.011380:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135681.011382:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135681.011388:0:17082:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783135681.011390:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135681.011393:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135681.011394:0:17082:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783135681.011396:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135681.011402:0:17082:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ac541dc0000) 00000020:00000080:0.0:1783135681.011410:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783135681.011412:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783135681.011414:0:17082:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783135681.011416:0:17082:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783135681.011420:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783135681.012062:0:17082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac678352000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783135681.012081:0:17082:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ac541dc3380) 00000020:00000080:0.0:1783135681.012299:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783135681.012359:0:17082:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783135681.012366:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628ee0aef 00000020:00000080:0.0:1783135681.012495:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783135681.012502:0:17082:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783135681.012506:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf7de4ef628ee0af6 00080000:01000000:0.0:1783135681.012512:0:17082:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783135681.012516:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628ee0afd 00010000:00010000:2.0:1783135681.132303:0:17082:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783135681.133731:0:17082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1783135681.134608:0:17082:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783135681.135748:0:17082:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ac54359b380) 00000020:00000080:2.0:1783135681.135772:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783135681.135871:0:17082:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783135681.135880:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628ee0b0b 00000020:00000080:3.0:1783135681.137716:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783135681.149326:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf7de4ef628ee0b12 00000020:00000080:3.0:1783135681.150647:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783135681.150710:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135681.150719:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135681.150721:0:17082:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783135681.150725:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783135681.150728:0:17082:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1783135681.150729:0:17082:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135681.150731:0:17082:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135681.150732:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783135681.150735:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135681.150736:0:17082:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783135681.150738:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135681.150745:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135681.150746:0:17082:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783135681.150751:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783135681.150813:0:17082:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783135681.150832:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135681.150836:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135681.150837:0:17082:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783135681.150847:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135681.150851:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135681.150852:0:17082:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783135681.150855:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783135681.150862:0:17082:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:00000080:3.0:1783135681.150893:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135681.150913:0:17082:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ac6580119c0) 00000020:00000080:3.0:1783135681.150932:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1783135681.150937:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783135681.151002:0:17082:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783135681.151009:0:17082:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783135681.151016:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628ee0b20 00010000:00080000:3.0:1783135681.151057:0:17082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac660a3f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:0.0:1783135681.153001:0:17082:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1783135681.166036:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783135681.166056:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783135681.166233:0:17082:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783135681.166259:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628ee0b27 00000100:00080000:0.0:1783135681.166272:0:17082:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135681.166278:0:17082:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ac660a3f800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135681.166317:0:17082:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438ae300 x1869752809204608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135681.166348:0:17082:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1783135681.166544:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135681.166550:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135681.166552:0:17082:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1783135681.166555:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783135681.166559:0:17082:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1783135681.166560:0:17082:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783135681.166562:0:17082:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783135681.166563:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783135681.166566:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135681.166567:0:17082:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783135681.166570:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783135681.166575:0:17082:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1783135681.166578:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135681.166579:0:17082:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783135681.166582:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783135681.166587:0:17082:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:0.0:1783135681.166616:0:17082:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783135681.166620:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135681.166648:0:17082:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ac541dc19c0) 00000020:00000080:0.0:1783135681.166662:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1783135681.166667:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783135681.166741:0:17082:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783135681.166748:0:17082:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783135681.166754:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628ee0b35 00010000:00080000:0.0:1783135681.166800:0:17082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac544115000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:0.0:1783135681.167133:0:17082:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1783135681.168254:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809204608:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783135681.168375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135681.168646:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809204608 00000100:00100000:1.0:1783135681.168658:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809204608 00000100:00100000:1.0:1783135681.168695:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135681.168704:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869752809204608:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1783135681.168727:0:17069:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1783135681.177052:0:17082:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783135681.177421:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783135681.187798:0:17082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135681.188194:0:17082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1783135681.196385:0:17082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1783135681.201194:0:17088:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783135681.201202:0:17088:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783135681.204499:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135681.204519:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783135681.204566:0:17082:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783135681.204588:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628ee0b3c 00000100:00080000:2.0:1783135681.204600:0:17082:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135681.204619:0:17082:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ac544115000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135681.204919:0:17082:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438b1880 x1869752809204736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135681.204968:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809204736:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783135681.205037:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752809204736 offset 0 length 520: 4 00000100:00080000:2.0:1783135681.205170:0:17082:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783135681.205268:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135681.205274:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135681.205276:0:17082:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783135681.205279:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783135681.205282:0:17082:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1783135681.205284:0:17082:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135681.205285:0:17082:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135681.205286:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783135681.205289:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135681.205290:0:17082:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783135681.205293:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783135681.205297:0:17082:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783135681.205300:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135681.205301:0:17082:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783135681.205317:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783135681.205321:0:17082:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:2.0:1783135681.205342:0:17082:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783135681.205345:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135681.205360:0:17082:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ac5435999c0) 00000020:00000080:2.0:1783135681.205375:0:17082:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1783135681.205380:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783135681.205449:0:17082:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783135681.205456:0:17082:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783135681.205465:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf7de4ef628ee0b4a 00010000:00080000:2.0:1783135681.205497:0:17082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac67c3d0800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:2.0:1783135681.205726:0:17082:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1783135681.205982:0:17082:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783135681.206002:0:17082:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783135681.208156:0:17082:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135681.209525:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869752809204608:12345-0@lo:38:llog_process_th.0 Request processed in 40813us (41142us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135681.209544:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783135681.209748:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135681.209756:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135681.209759:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809204608:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1783135681.210317:0:17082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1783135681.210554:0:17082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1783135681.211204:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1783135681.211361:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783135681.211366:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783135681.211370:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135681.211377:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 584 00000100:00080000:1.0:1783135681.211382:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783135681.211397:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ac660a3f800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135681.211422:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67b3b2680 x1869752809204992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135681.211447:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135681.211451:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1783135681.211575:0:17090:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783135681.211580:0:17090:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1783135681.211715:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809204992:0@lo:38:kworker.0 00000100:00100000:2.0:1783135681.211777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.212135:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809204992 00000100:00100000:0.0:1783135681.212144:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809204992 00000100:00100000:0.0:1783135681.212178:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135681.212186:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869752809204992:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783135681.212203:0:17070:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783135681.212248:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869752809204992:12345-0@lo:38:kworker.0 Request processed in 62us (471us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135681.212255:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783135681.212296:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135681.212300:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783135681.212303:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809204992:0@lo:38:kworker.0 00000020:00000080:1.0:1783135681.213032:0:17082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135681.213046:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783135681.213155:0:17082:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783135681.213178:0:17082:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628ee0b51 00000100:00080000:1.0:1783135681.213185:0:17082:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135681.213189:0:17082:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ac67c3d0800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135681.213215:0:17082:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67b3b3100 x1869752809205120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135681.213233:0:17082:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783135681.213292:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135681.213296:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135681.213298:0:17082:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783135681.213301:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135681.213305:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135681.213307:0:17082:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783135681.213309:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783135681.213311:0:17082:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783135681.213313:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135681.213315:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135681.213316:0:17082:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783135681.213319:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135681.213321:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135681.213322:0:17082:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783135681.213326:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783135681.213364:0:17082:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17082:1869752809205248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135681.213425:0:17082:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135681.213466:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809205248 00000100:00100000:1.0:1783135681.213471:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809205248 00000100:00100000:1.0:1783135681.213506:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135681.213514:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+9:17082:x1869752809205248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135681.213618:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+9:17082:x1869752809205248:12345-0@lo:502:llog_process_th.0 Request processed in 104us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135681.213862:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809205120:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783135681.213890:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752809205120 offset 0 length 520: 4 00000100:00080000:2.0:1783135681.215117:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135681.215126:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783135681.216024:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809204864:0@lo:400:kworker.0 00000100:00100000:3.0:1783135681.216122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135681.216190:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809204864 00000100:00100000:3.0:1783135681.216198:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809204864 00000100:00100000:3.0:1783135681.216236:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135681.216245:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+10:3646:x1869752809204864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135681.216300:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+10:3646:x1869752809204864:12345-0@lo:400:kworker.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.216307:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135681.216356:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809204864:0@lo:400:kworker.0 00000100:00100000:1.0:1783135681.220213:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135681.220327:0:17082:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660731d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.220364:0:17082:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17082:1869752809205248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135681.220409:0:17082:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135681.220420:0:17082:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135681.220423:0:17082:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783135681.220428:0:17082:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783135681.220619:0:17043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783135681.220650:0:17043:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783135681.220676:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628ee0ac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0acc expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.220689:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650988800/0xf7de4ef628ee0ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0acc expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135681.220697:0:17043:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac678352000 from 1 10000000:01000000:0.0:1783135681.220710:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135681.220751:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.220760:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.220770:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135681.220839:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809205376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135681.220909:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.220946:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67838b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.221181:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809205376 00000100:00100000:1.0:1783135681.221189:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809205376 00000100:00100000:1.0:1783135681.221236:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135681.221246:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+9:17043:x1869752809205376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135681.221260:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135681.221275:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee0b5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0b58 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135681.221303:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee0b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b58 expref: 10 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135681.221313:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee0b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b58 expref: 10 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135681.221332:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20ee00, rc 0) 00000100:00100000:1.0:1783135681.221425:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+10:17043:x1869752809205376:12345-0@lo:101:mount.lustre.0 Request processed in 179us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135681.221432:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135681.223493:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809205376:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135681.223527:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.223541:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135681.226072:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809205504:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783135681.227975:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135681.228027:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.228141:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809205504 00000100:00100000:1.0:1783135681.228151:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809205504 00000100:00100000:1.0:1783135681.228806:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135681.228828:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+10:17043:x1869752809205504:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783135681.228858:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783135681.228864:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783135681.228968:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+10:17043:x1869752809205504:12345-0@lo:256:mount.lustre.0 Request processed in 152us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135681.228975:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135681.229074:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809205504:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783135681.229732:0:17043:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783135681.229759:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.229772:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135681.229792:0:17043:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac678352000 from 1 10000000:01000000:3.0:1783135681.229795:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135681.229838:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.229846:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.229856:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135681.229880:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809205632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135681.229923:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135681.233353:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543882780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135681.233494:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809205632 00000100:00100000:2.0:1783135681.233504:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809205632 00000100:00100000:3.0:1783135681.233702:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135681.233723:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+10:17043:x1869752809205632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135681.233741:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135681.233766:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac682172400/0xf7de4ef628ee0b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0b66 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.233961:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac682172400/0xf7de4ef628ee0b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b66 expref: 11 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.233974:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac682172400/0xf7de4ef628ee0b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b66 expref: 11 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.233983:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac682172400, rc 0) 00000100:00100000:3.0:1783135681.234058:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17043:x1869752809205632:12345-0@lo:101:mount.lustre.0 Request processed in 348us (4134us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.234066:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135681.234497:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809205632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135681.234517:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135681.234526:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135681.234626:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809205760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135681.234659:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135681.234692:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6586f3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135681.234940:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809205760 00000100:00100000:3.0:1783135681.234945:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809205760 00000100:00100000:3.0:1783135681.234979:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135681.234986:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17043:x1869752809205760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135681.235155:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17043:x1869752809205760:12345-0@lo:501:mount.lustre.0 Request processed in 168us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.235162:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135681.235238:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809205760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135681.235280:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809205888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135681.235312:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135681.235337:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6586f3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135681.235382:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809205888 00000100:00100000:3.0:1783135681.235386:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809205888 00000100:00100000:3.0:1783135681.235401:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135681.235406:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17043:x1869752809205888:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135681.235477:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17043:x1869752809205888:12345-0@lo:503:mount.lustre.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.235484:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135681.235921:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809205888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135681.236422:0:17092:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17092:1869752809206016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135681.236470:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135681.236537:0:17092:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6586f3480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135681.236577:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809206016 00000100:00100000:3.0:1783135681.236583:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809206016 00000100:00100000:3.0:1783135681.237049:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135681.237059:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17092:x1869752809206016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135681.237553:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17092:x1869752809206016:12345-0@lo:502:llog_process_th.0 Request processed in 493us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.237561:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135681.237728:0:17092:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17092:1869752809206016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783135681.237761:0:17092:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135681.237771:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135681.237774:0:17092:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783135681.237793:0:17092:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac678352000 00000020:00000080:2.0:1783135681.237795:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135681.237803:0:17092:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135681.237805:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135681.237806:0:17092:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783135681.237808:0:17092:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135681.237811:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135681.237812:0:17092:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783135681.237878:0:17092:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac678352000 00000020:00000080:2.0:1783135681.237881:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135681.237960:0:17092:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135681.237965:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135681.237966:0:17092:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783135681.237968:0:17092:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135681.237971:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135681.237972:0:17092:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783135681.237975:0:17092:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac678352000 00000020:00000080:2.0:1783135681.237977:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135681.237994:0:17092:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135681.237997:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135681.237998:0:17092:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783135681.238000:0:17092:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135681.238002:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135681.238004:0:17092:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1783135681.238007:0:17092:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac678352000 00000020:00000080:2.0:1783135681.238009:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783135681.238052:0:17092:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17092:1869752809206144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135681.238126:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135681.242309:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809206144 00000100:00100000:3.0:1783135681.242327:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809206144 00000100:00100000:3.0:1783135681.242381:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135681.242393:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17092:x1869752809206144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135681.242553:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17092:x1869752809206144:12345-0@lo:502:llog_process_th.0 Request processed in 162us (4425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.242561:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135681.253166:0:17092:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6586f3480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.253215:0:17092:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17092:1869752809206144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135681.253257:0:17092:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135681.253267:0:17092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135681.253270:0:17092:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783135681.253275:0:17092:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783135681.253451:0:17043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783135681.253475:0:17043:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135681.253532:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.253544:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135681.253615:0:17043:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783135681.253619:0:17043:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ac678352000 10000000:01000000:3.0:1783135681.253622:0:17043:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ac678352000 10000000:01000000:3.0:1783135681.253627:0:17043:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135681.253633:0:17043:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac678352000 from 1 10000000:01000000:3.0:1783135681.253636:0:17043:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783135681.253672:0:17043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac682173600/0xf7de4ef628ee0b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.253692:0:17043:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac682173600/0xf7de4ef628ee0b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.253702:0:17043:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac682173600/0xf7de4ef628ee0b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135681.253727:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809206272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135681.255117:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135681.255163:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660868780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135681.255707:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809206272 00000100:00100000:2.0:1783135681.255718:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809206272 00000100:00100000:2.0:1783135681.255773:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135681.255792:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17043:x1869752809206272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135681.255820:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135681.255843:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67f909e00/0xf7de4ef628ee0b7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0b74 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135681.255874:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67f909e00/0xf7de4ef628ee0b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b74 expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135681.255886:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67f909e00/0xf7de4ef628ee0b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b74 expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135681.255907:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909e00, rc 0) 00000100:00100000:2.0:1783135681.255974:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17043:x1869752809206272:12345-0@lo:101:mount.lustre.0 Request processed in 183us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135681.255982:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135681.256178:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809206272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135681.256197:0:17043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac682173600/0xf7de4ef628ee0b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b7b expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.256208:0:17043:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac682173600/0xf7de4ef628ee0b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0b7b expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135681.256286:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809206400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135681.256319:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135681.256342:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660868780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135681.260229:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809206400 00000100:00100000:2.0:1783135681.260246:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809206400 00000100:00100000:2.0:1783135681.260309:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135681.260321:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17043:x1869752809206400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135681.260538:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17043:x1869752809206400:12345-0@lo:501:mount.lustre.0 Request processed in 219us (4217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135681.260547:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135681.262955:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809206400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135681.263017:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809206528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135681.263113:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.263153:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.263456:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809206528 00000100:00100000:1.0:1783135681.263464:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809206528 00000100:00100000:1.0:1783135681.263516:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135681.263524:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17043:x1869752809206528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135681.263737:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17043:x1869752809206528:12345-0@lo:503:mount.lustre.0 Request processed in 213us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135681.263746:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783135681.263923:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809206528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135681.266220:0:17097:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17097:1869752809206656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135681.266313:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.266359:0:17097:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135681.266430:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809206656 00000100:00100000:1.0:1783135681.266437:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809206656 00000100:00100000:1.0:1783135681.266483:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135681.266494:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17097:x1869752809206656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135681.266983:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17097:x1869752809206656:12345-0@lo:502:llog_process_th.0 Request processed in 489us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135681.266991:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783135681.275170:0:17097:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17097:1869752809206656:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783135681.275265:0:17097:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783135681.275301:0:17097:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ac67e698000) 00000020:00000080:0.0:1783135681.275327:0:17097:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1783135681.276258:0:17097:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac678352000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783135681.276265:0:17097:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac678352000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783135681.276268:0:17097:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac678352000 4 00010000:00080000:1.0:1783135681.276303:0:17097:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac643717000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1783135681.282510:0:17097:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1783135681.282634:0:17097:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783135681.282685:0:17097:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783135681.282701:0:17097:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf7de4ef628ee0b89 00000100:00080000:1.0:1783135681.282713:0:17097:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135681.282720:0:17097:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ac643717000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135681.282759:0:17097:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67b3b1500 x1869752809206784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135681.282795:0:17097:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783135681.282905:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135681.282910:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135681.284209:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869752809206784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783135681.284295:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135681.284371:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809206784 00000100:00100000:1.0:1783135681.284379:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809206784 00000100:00100000:1.0:1783135681.284433:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135681.284441:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869752809206784:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135681.284503:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1869752809206784:12345-0@lo:38:llog_process_th.0 Request processed in 61us (208us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783135681.284511:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135681.284550:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135681.284564:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac643717000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135681.284568:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783135681.284572:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869752809206784:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135681.287311:0:17097:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17097:1869752809206912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135681.287404:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135681.287448:0:17097:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660731540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135681.287613:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809206912 00000100:00100000:3.0:1783135681.287621:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809206912 00000100:00100000:3.0:1783135681.287666:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135681.287676:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17097:x1869752809206912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135681.287813:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17097:x1869752809206912:12345-0@lo:502:llog_process_th.0 Request processed in 138us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.287821:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135681.287878:0:17097:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17097:1869752809206912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135681.288110:0:17097:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17097:1869752809207040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135681.288140:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135681.288164:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809207040 00000100:00100000:3.0:1783135681.288167:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809207040 00000100:00100000:2.0:1783135681.288182:0:17097:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6608680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135681.288190:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135681.288198:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17097:x1869752809207040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135681.288308:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17097:x1869752809207040:12345-0@lo:502:llog_process_th.0 Request processed in 110us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.288314:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135681.288368:0:17097:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17097:1869752809207040:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783135681.288386:0:17097:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783135681.289501:0:17043:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783135681.289540:0:17043:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135681.289562:0:17043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac682173600/0xf7de4ef628ee0b74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b7b expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.289575:0:17043:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac682173600/0xf7de4ef628ee0b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b7b expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783135681.289711:0:17043:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783135681.289714:0:17043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783135681.289716:0:17043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135681.289717:0:17043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135681.289718:0:17043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135681.289720:0:17043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135681.289721:0:17043:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135681.289723:0:17043:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783135681.289725:0:17043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135681.289726:0:17043:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135681.289731:0:17043:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783135681.289734:0:17043:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135681.289742:0:17043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783135681.289743:0:17043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135681.289744:0:17043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135681.289745:0:17043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135681.289746:0:17043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135681.289746:0:17043:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135681.289747:0:17043:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783135681.289748:0:17043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135681.289749:0:17043:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135681.289772:0:17043:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783135681.289804:0:17043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809207168:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783135681.289877:0:17043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135681.289992:0:17043:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660868480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135681.290023:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809207168 00000100:00100000:3.0:1783135681.290029:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809207168 00000100:00100000:3.0:1783135681.290066:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135681.290075:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17043:x1869752809207168:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135681.290117:0:17056:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783135681.290133:0:17056:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783135681.292330:0:17056:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783135681.292356:0:17056:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783135681.292774:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17043:x1869752809207168:12345-0@lo:253:mount.lustre.0 Request processed in 2693us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.292799:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135681.292892:0:17043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17043:1869752809207168:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783135681.292907:0:17043:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783135681.292910:0:17043:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135681.292912:0:17043:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783135681.292913:0:17043:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135681.292914:0:17043:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135681.292916:0:17043:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135681.292917:0:17043:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135681.292918:0:17043:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135681.292925:0:17043:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783135681.292927:0:17043:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135681.292929:0:17043:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783135681.292947:0:17043:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1783135681.295184:0:17080:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783135681.295196:0:17080:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783135681.295227:0:17080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.295245:0:17080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee0b5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b58 expref: 11 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.295254:0:17080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.295297:0:17080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee0b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0b58 expref: 11 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.295313:0:17080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee0b5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b58 expref: 11 pid: 17056 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135681.295328:0:17080:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809207296:0@lo:104: 00000100:00100000:0.0:1783135681.295390:0:17080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135681.295430:0:17080:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cd840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135681.296186:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809207296 00000100:00100000:0.0:1783135681.296196:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809207296 00000100:00100000:0.0:1783135681.296243:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135681.296252:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:17080:x1869752809207296:12345-0@lo:104: 00010000:00010000:0.0:1783135681.296266:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135681.296332:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135681.296338:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:17080:x1869752809207296:12345-0@lo:104: Request processed in 88us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135681.296345:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135681.296387:0:17080:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809207296:0@lo:104: 00010000:00010000:0.0:1783135681.296407:0:17080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.299575:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135681.299592:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.299604:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989e00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135681.299609:0:17053:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.299619:0:17053:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135681.299626:0:17053:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135681.299631:0:17053:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135681.299734:0:17053:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.299740:0:17053:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135681.299790:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.299797:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0b5f expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.299829:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135681.299831:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135681.299833:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135681.299879:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135681.299900:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3649:1869752809207424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135681.300154:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135681.300432:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809207424 00000100:00100000:3.0:1783135681.300441:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809207424 00010000:00010000:3.0:1783135681.300474:0:17049:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee0b5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b58 expref: 12 pid: 17056 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135681.300566:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135681.300578:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:3649:x1869752809207424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135681.300604:0:17049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135681.300610:0:17049:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee0b5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b58 expref: 12 pid: 17056 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300621:0:17049:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee0b5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b58 expref: 12 pid: 17056 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300633:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee0b5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0b58 expref: 12 pid: 17056 timeout: 685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300647:0:17049:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300655:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783135681.300672:0:17049:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005476921s 00010000:00010000:3.0:1783135681.300676:0:17049:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300683:0:17049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300695:0:17049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300702:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300707:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650988c00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135681.300711:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300718:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300733:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300744:0:17049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135681.300798:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:3649:x1869752809207424:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135681.300805:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783135681.300904:0:17080:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300913:0:17080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135681.300919:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac650988c00/0xf7de4ef628ee0b90 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135681.301250:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3649:1869752809207424:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1783135681.310447:0:17043:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1783135681.310792:0:17043:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1783135681.311219:0:17105:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783135681.311501:0:17043:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1783135681.311715:0:17105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1783135681.312733:0:17104:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1783135681.312740:0:17104:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:0.0:1783135681.313051:0:17106:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8ac5438adf80 x1869752809207552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135681.313064:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00000040:01000000:0.0:1783135681.314259:0:17043:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1783135681.314295:0:17043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135681.315284:0:17105:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00000080:0.0:1783135681.315284:0:17043:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1783135681.315297:0:17043:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000004:00080000:3.0:1783135681.315360:0:17105:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1783135681.315361:0:17043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135681.316950:0:17043:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783135681.318020:0:17043:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783135681.318064:0:17043:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1783135681.319454:0:17043:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1783135681.321448:0:17043:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1783135681.323988:0:17043:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783135681.324036:0:17043:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa3f9c18bf988 00100000:10000000:0.0:1783135681.324046:0:17043:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783135681.325294:0:17043:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783135681.325315:0:17043:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783135681.325341:0:17043:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783135681.325367:0:17043:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1783135681.326343:0:17043:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783135681.326559:0:17043:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135681.902253:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135682.286731:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783135682.350173:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 10000000:01000000:1.0:1783135682.478203:0:17061:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783135682.478212:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac678352000 from 7 10000000:01000000:1.0:1783135682.478217:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783135682.478275:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135682.478287:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135682.478299:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135682.478325:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809207680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135682.478461:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135682.478523:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b1c3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135682.478682:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809207680 00000100:00100000:3.0:1783135682.478691:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809207680 00000100:00100000:3.0:1783135682.478766:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135682.478776:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+11:17061:x1869752809207680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135682.478911:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135682.478930:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac682172800/0xf7de4ef628ee0b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0b97 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135682.478961:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac682172800/0xf7de4ef628ee0b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b97 expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135682.479050:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac682172800/0xf7de4ef628ee0b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b97 expref: 12 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135682.479060:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac682172800, rc 0) 00000100:00100000:3.0:1783135682.479222:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17061:x1869752809207680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 447us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135682.479230:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135682.479349:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809207680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135682.479367:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135682.479376:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135682.484738:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809207808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783135682.484857:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135682.484901:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135682.485083:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809207808 00000100:00100000:3.0:1783135682.485131:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809207808 00000100:00100000:3.0:1783135682.485198:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783135682.485208:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17061:x1869752809207808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783135682.485232:0:17056:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783135682.485260:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783135682.485268:0:17056:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783135682.485381:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17061:x1869752809207808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 173us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135682.485389:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135682.486229:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809207808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783135682.486298:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135682.486310:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135682.486321:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135682.926282:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135683.310834:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783135683.375142:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1783135683.950611:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135684.403249:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1783135684.974951:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135685.439345:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00000001:02000400:1.0:1783135685.916479:0:17349:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783135685.999443:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135686.447568:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00000100:00100000:3.0:1783135686.511443:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3649:1869752809207936:0@lo:400:kworker.0 00000100:00100000:3.0:1783135686.511526:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783135686.511968:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783135686.511974:0:13713:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783135686.511977:0:13713:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135686.511983:0:13713:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 585 00000100:00080000:0.0:1783135686.511988:0:13713:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783135686.511995:0:13713:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ac660a3f800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135686.512019:0:13713:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438aed80 x1869752809208064/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135686.512036:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135686.512039:0:13713:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135686.512042:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135686.512045:0:13713:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135686.512047:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783135686.512050:0:13713:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783135686.512052:0:13713:0:(import.c:65:import_set_state_nolock()) ffff8ac643717000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135686.512057:0:13713:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ac643717000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135686.512080:0:13713:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438af480 x1869752809208192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135686.512185:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809207936 00000100:00100000:2.0:1783135686.512202:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809207936 00000100:00100000:2.0:1783135686.512264:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135686.512274:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:3649:x1869752809207936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135686.512413:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:3649:x1869752809207936:12345-0@lo:400:kworker.0 Request processed in 140us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135686.512420:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135686.512530:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3649:1869752809207936:0@lo:400:kworker.0 00000100:00100000:1.0:1783135686.512802:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809208064:0@lo:38:kworker.0 00000100:00100000:1.0:1783135686.512840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135686.512870:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869752809208192:0@lo:38:kworker.0 00000100:00100000:0.0:1783135686.512876:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809208064 00000100:00100000:0.0:1783135686.512881:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809208064 00000100:00100000:1.0:1783135686.512893:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135686.512913:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135686.512918:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869752809208064:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783135686.512934:0:17070:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783135686.517203:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809208192 00000100:00100000:3.0:1783135686.517219:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809208192 00000100:00100000:3.0:1783135686.517255:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135686.517264:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809208192:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783135686.517294:0:17066:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:3.0:1783135686.517426:0:17066:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf7de4ef628ee0ba5 00000004:00100000:3.0:1783135686.517446:0:17066:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783135686.518868:0:17066:0:(import.c:65:import_set_state_nolock()) ffff8ac67c6fc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135686.518974:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1869752809208192:12345-0@lo:38:kworker.0 Request processed in 1708us (6076us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135686.518984:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783135686.520805:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ac5438af480 x1869752809208192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135686.520827:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783135686.520838:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783135686.520843:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783135686.520860:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac643717000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783135686.520867:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1869752809208192:0@lo:38:kworker.0 00000100:00100000:0.0:1783135686.531911:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869752809208064:12345-0@lo:38:kworker.0 Request processed in 18980us (19059us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135686.531929:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783135686.531977:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135686.531984:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135686.531988:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809208064:0@lo:38:kworker.0 00000020:00000004:2.0:1783135686.976050:0:17401:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783135686.979546:0:17401:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783135687.034722:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135687.491877:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00000020:00000004:3.0:1783135688.031982:0:17451:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135688.032519:0:17451:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783135688.048137:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135688.494491:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:1.0:1783135689.074113:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135689.518239:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1783135690.096292:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135690.543852:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1783135691.123971:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135691.566175:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00000100:00080000:0.0:1783135691.630257:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783135691.630266:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783135691.630270:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135691.630280:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 590 00000100:00080000:0.0:1783135691.630287:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783135691.630296:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ac660a3f800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135691.630327:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438af480 x1869752809208448/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135691.630341:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135691.630345:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135691.630347:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135691.630350:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135691.630385:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809208576:0@lo:400:kworker.0 00000100:00100000:1.0:1783135691.630423:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809208320:0@lo:400:kworker.0 00000100:00100000:1.0:1783135691.630528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135691.631633:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135681/real 1783135681] req@ffff8ac67b3b3100 x1869752809205120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135691 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135691.631662:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac67b3b3100 x1869752809205120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135691 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135691.631675:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135681/real 1783135681] req@ffff8ac5438b1880 x1869752809204736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135691 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135691.631688:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac5438b1880 x1869752809204736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135691 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135691.631708:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809208448:0@lo:38:kworker.0 00000100:00100000:2.0:1783135691.631821:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783135691.631855:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135691.631872:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135691.631876:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809205120:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783135691.631889:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac544115000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135691.631895:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135691.631899:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809204736:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783135691.631944:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809208448 00000100:00100000:2.0:1783135691.631952:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809208448 00000100:00100000:2.0:1783135691.632005:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135691.632014:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869752809208448:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783135691.632035:0:17069:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783135691.633055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135691.633152:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809208320 00000100:00100000:0.0:1783135691.633160:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809208320 00000100:00100000:0.0:1783135691.633204:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135691.633213:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:3646:x1869752809208320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135691.633281:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:3646:x1869752809208320:12345-0@lo:400:kworker.0 Request processed in 69us (2753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135691.633289:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1783135691.633343:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135691.633348:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783135691.633352:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac544115000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135691.633358:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 584 00000100:00080000:0.0:1783135691.633363:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135691.633368:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ac544115000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135691.633400:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438af100 x1869752809208704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135691.633421:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135691.633425:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783135691.633427:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135691.633430:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 585 00000100:00080000:0.0:1783135691.633433:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135691.633436:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ac67c3d0800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135691.633448:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438afb80 x1869752809208832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135691.633495:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809208320:0@lo:400:kworker.0 00000100:00100000:0.0:1783135691.633550:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809208704:0@lo:8:kworker.0 00000400:00000100:0.0:1783135691.633900:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752809208704 offset 0 length 520: 4 00000100:00100000:0.0:1783135691.633959:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809208832:0@lo:8:kworker.0 00000400:00000100:0.0:1783135691.633993:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752809208832 offset 0 length 520: 4 00000100:00100000:3.0:1783135691.652214:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809208576 00000100:00100000:3.0:1783135691.652236:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809208576 00000100:00100000:3.0:1783135691.652326:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135691.652339:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809208576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135691.652474:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809208576:12345-0@lo:400:kworker.0 Request processed in 138us (19424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135691.652482:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135691.656058:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869752809208448:12345-0@lo:38:kworker.0 Request processed in 24033us (24226us total) trans 0 rc -19/-19 00010000:00080000:0.0:1783135691.656071:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ac5438adc00 x1869752809208576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135691.656080:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135691.657730:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809208576:0@lo:400:kworker.0 00000100:00080000:3.0:1783135691.662944:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135691.662963:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135691.662970:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809208448:0@lo:38:kworker.0 00010000:00010000:3.0:1783135692.157478:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135692.590176:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1783135693.166348:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135693.553347:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783135693.614444:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1783135694.190644:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135694.646694:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1783135695.214267:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135695.663371:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:0.0:1783135696.238512:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135696.687304:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00000100:00080000:3.0:1783135696.753831:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783135696.753840:0:13713:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783135696.753846:0:13713:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135696.753858:0:13713:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:3.0:1783135696.753864:0:13713:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783135696.753874:0:13713:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ac660a3f800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135696.753902:0:13713:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67f84ca80 x1869752809209088/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135696.753920:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135696.753933:0:13713:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135696.753936:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135696.753939:0:13713:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783135696.753976:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809209216:0@lo:400:kworker.0 00000100:00100000:3.0:1783135696.754081:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135696.754171:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135696.754178:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3649:1869752809208960:0@lo:400:kworker.0 00000100:00100000:3.0:1783135696.754347:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135696.754452:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809209216 00000100:00100000:3.0:1783135696.754465:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809209216 00000100:00100000:2.0:1783135696.754785:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809208960 00000100:00100000:2.0:1783135696.754795:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809208960 00000100:00100000:2.0:1783135696.754866:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135696.754879:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:3649:x1869752809208960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135696.754957:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:3649:x1869752809208960:12345-0@lo:400:kworker.0 Request processed in 82us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135696.754966:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135696.755034:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3649:1869752809208960:0@lo:400:kworker.0 00000100:00100000:3.0:1783135696.755290:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135696.755301:0:17065:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783135696.755310:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809209216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135696.755316:0:17065:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783135696.755412:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809209216:12345-0@lo:400:kworker.0 Request processed in 109us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135696.755423:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135696.755470:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809209088:0@lo:38:kworker.0 00000100:00100000:3.0:1783135696.755529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783135696.755707:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ac67f84e680 x1869752809209216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135696.755723:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809209216:0@lo:400:kworker.0 00000100:00100000:2.0:1783135696.755793:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809209088 00000100:00100000:2.0:1783135696.755799:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809209088 00000100:00100000:2.0:1783135696.755832:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135696.755838:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869752809209088:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783135696.755862:0:17070:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783135696.794679:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1869752809209088:12345-0@lo:38:kworker.0 Request processed in 38821us (39131us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783135696.794702:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1783135696.796754:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135696.796768:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783135696.796773:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809209088:0@lo:38:kworker.0 00010000:00010000:0.0:1783135697.269040:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783135697.386160:0:17797:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783135697.386164:0:17797:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783135697.386166:0:17797:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1783135697.387521:0:17797:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ac5424bf000 00000020:01000004:3.0:1783135697.387539:0:17797:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1783135697.387552:0:17797:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783135697.387566:0:17797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8ac658013380) 00000020:00000080:3.0:1783135697.387583:0:17797:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1783135697.591812:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1783135697.592188:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1783135697.592939:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1783135697.593427:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1783135697.593917:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1783135697.596261:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1783135697.598606:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1783135697.600520:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1783135697.603306:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1783135697.604024:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1783135697.606762:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783135697.607319:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783135697.607720:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783135697.607961:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783135697.608572:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.609539:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.609953:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.610317:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.610715:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.611043:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.611442:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.611818:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.612049:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.612441:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.612809:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.613021:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.613339:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.613732:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.614054:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.614500:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.614809:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.615004:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.615344:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.615736:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.615981:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.616324:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.616815:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.617300:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.618128:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.618586:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.618855:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.619115:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.619460:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1783135697.619807:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.620007:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1783135697.620317:0:17797:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00080000:01000000:3.0:1783135697.626977:0:17797:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783135697.627444:0:17797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1783135697.627456:0:17797:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135697.627467:0:17797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628ee0bb3 00000020:01000004:3.0:1783135697.627485:0:17797:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783135697.627508:0:17797:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783135697.627512:0:17797:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783135697.627518:0:17797:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1783135697.627548:0:17797:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1783135697.627553:0:17797:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1783135697.641612:0:17797:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783135697.641671:0:17797:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.106@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1783135697.641676:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783135697.641678:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783135697.641680:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135697.641681:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135697.641682:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135697.641683:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135697.641685:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135697.641687:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135697.641688:0:17797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135697.641692:0:17797:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1783135697.641694:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135697.641696:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783135697.641697:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135697.641698:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135697.641699:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135697.641700:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135697.641701:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135697.641708:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135697.641709:0:17797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135697.641740:0:17797:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1783135697.641764:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135697.645022:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135697.645122:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135697.648131:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809209344 00000100:00100000:0.0:1783135697.648154:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809209344 00000100:00100000:0.0:1783135697.648222:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135697.648234:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17797:x1869752809209344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135697.648273:0:17056:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783135697.648277:0:17056:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1783135697.648283:0:17056:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1783135697.648865:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17797:x1869752809209344:12345-0@lo:253:mount.lustre.0 Request processed in 631us (3848us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135697.648891:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135697.649048:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209344:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783135697.649063:0:17797:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1783135697.649066:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135697.649068:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783135697.649069:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135697.649070:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135697.649072:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135697.649073:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135697.649074:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135697.649077:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135697.649078:0:17797:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783135697.649116:0:17797:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ac5424bf000 from lustre-MDT0001 10000000:01000000:3.0:1783135697.649170:0:17797:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1783135697.649177:0:17797:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783135697.649183:0:17797:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ac543598000 local copy 00010000:00010000:3.0:1783135697.649195:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135697.649314:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135697.649363:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135697.649396:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135697.649816:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809209472 00000100:00100000:0.0:1783135697.649824:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809209472 00000100:00100000:0.0:1783135697.649863:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783135697.649872:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17797:x1869752809209472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135697.649957:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17797:x1869752809209472:12345-0@lo:501:mount.lustre.0 Request processed in 86us (594us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135697.649965:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135697.650702:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209472:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783135697.650726:0:17797:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783135697.650755:0:17797:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783135697.650763:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.650771:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135697.650803:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ac5424bf000 10000000:01000000:3.0:1783135697.650807:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783135697.650812:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ac543598000 10000000:01000000:3.0:1783135697.650814:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783135697.650827:0:17797:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8ac543598000 from 1 10000000:01000000:3.0:1783135697.650830:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783135697.650859:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628ee0bba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.650868:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628ee0bba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.650895:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628ee0bba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135697.650913:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135697.650950:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135697.650993:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135697.651268:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809209600 00000100:00100000:0.0:1783135697.651274:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809209600 00000100:00100000:0.0:1783135697.651314:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783135697.651323:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+12:17797:x1869752809209600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135697.651335:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135697.651408:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac650989600/0xf7de4ef628ee0bc1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0bba expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135697.651434:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650989600/0xf7de4ef628ee0bc1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0bba expref: 13 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135697.651444:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac650989600/0xf7de4ef628ee0bc1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0bba expref: 13 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135697.651454:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650989600, rc 0) 00000100:00100000:0.0:1783135697.651575:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+13:17797:x1869752809209600:12345-0@lo:101:mount.lustre.0 Request processed in 252us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135697.651583:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135697.652070:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135697.652125:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628ee0bba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0bc1 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.652135:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628ee0bba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0bc1 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135697.652266:0:17797:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783135697.652285:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628ee0bba lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0bc1 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.652293:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c526600/0xf7de4ef628ee0bba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0bc1 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135697.652302:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ac5424bf000 10000000:01000000:3.0:1783135697.652307:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783135697.652312:0:17797:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8ac5424bf000 from 1 10000000:01000000:3.0:1783135697.652314:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783135697.652338:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628ee0bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.652478:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628ee0bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.652563:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628ee0bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135697.652586:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135697.652626:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135697.654639:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135697.662482:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809209728 00000100:00100000:1.0:1783135697.662503:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809209728 00000100:00100000:1.0:1783135697.662584:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135697.662595:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+13:17797:x1869752809209728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135697.662614:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135697.662634:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628ee0bcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0bc8 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135697.662678:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628ee0bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0bc8 expref: 14 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135697.662690:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20f000/0xf7de4ef628ee0bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0bc8 expref: 14 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135697.662700:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f000, rc 0) 00000100:00100000:1.0:1783135697.662803:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+14:17797:x1869752809209728:12345-0@lo:101:mount.lustre.0 Request processed in 209us (10175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135697.662810:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783135697.664129:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135697.664166:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628ee0bc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0bcf expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.664177:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628ee0bc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0bcf expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135697.664197:0:17797:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783135697.664220:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628ee0bc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0bcf expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.664228:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c526000/0xf7de4ef628ee0bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0bcf expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135697.664237:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783135697.664246:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135697.664252:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ac5424bf000 10000000:01000000:3.0:1783135697.664256:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783135697.664259:0:17797:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1783135697.664262:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783135697.664293:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628ee0bd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.664323:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628ee0bd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.664333:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628ee0bd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135697.664361:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135697.664419:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135697.664480:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135697.664874:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809209856 00000100:00100000:0.0:1783135697.664883:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809209856 00000100:00100000:0.0:1783135697.664956:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783135697.664967:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+14:17797:x1869752809209856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135697.664985:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135697.665000:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac650988000/0xf7de4ef628ee0bdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0bd6 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135697.665024:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac650988000/0xf7de4ef628ee0bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0bd6 expref: 15 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135697.665036:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac650988000/0xf7de4ef628ee0bdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0bd6 expref: 15 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135697.665046:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac650988000, rc 0) 00000100:00100000:0.0:1783135697.665136:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+15:17797:x1869752809209856:12345-0@lo:101:mount.lustre.0 Request processed in 171us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135697.665157:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135697.665685:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135697.665705:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628ee0bd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0bdd expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.665714:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628ee0bd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0bdd expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135697.668003:0:17797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1783135697.669324:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135697.669580:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1783135697.669608:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1783135697.669623:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1783135697.669635:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1783135697.669648:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1783135697.669673:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1783135697.669691:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1783135697.669704:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1783135697.669719:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1783135697.669731:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1783135697.669754:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1783135697.669767:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1783135697.669779:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1783135697.669792:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1783135697.669808:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1783135697.669833:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1783135697.669849:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1783135697.669863:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1783135697.669878:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1783135697.669891:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1783135697.669903:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1783135697.669916:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1783135697.669930:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1783135697.669949:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1783135697.669954:0:17797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1783135697.670048:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135697.670169:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135697.670206:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5430723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135697.670426:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809209984 00000100:00100000:0.0:1783135697.670434:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809209984 00000100:00100000:0.0:1783135697.670494:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783135697.670515:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+15:17797:x1869752809209984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135697.670676:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+15:17797:x1869752809209984:12345-0@lo:501:mount.lustre.0 Request processed in 163us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135697.670685:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135697.671214:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809209984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135697.671256:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809210112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135697.671305:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135697.671329:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5430723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135697.671640:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809210112 00000100:00100000:0.0:1783135697.671646:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809210112 00000100:00100000:0.0:1783135697.671695:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783135697.671704:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+15:17797:x1869752809210112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135697.672746:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809210112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783135697.673260:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135697.673336:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809210240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135697.673388:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135697.673825:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135697.673896:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+15:17797:x1869752809210112:12345-0@lo:503:mount.lustre.0 Request processed in 2191us (2588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135697.673907:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783135697.673947:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809210240 00000100:00100000:0.0:1783135697.673953:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809210240 00000100:00100000:2.0:1783135697.676485:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783135697.676518:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+15:17797:x1869752809210240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135697.677947:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+15:17797:x1869752809210240:12345-0@lo:502:mount.lustre.0 Request processed in 1443us (4551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135697.677961:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135697.678302:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809210240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135697.678583:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783135697.678616:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1783135697.678631:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1783135697.678643:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1783135697.678658:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1783135697.678896:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1783135697.678912:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1783135697.678926:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1783135697.678939:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1783135697.678949:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1783135697.678960:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1783135697.678972:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1783135697.678988:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1783135697.678999:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1783135697.679010:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1783135697.679020:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1783135697.679029:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1783135697.679042:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1783135697.679061:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1783135697.679071:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1783135697.679081:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1783135697.679122:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1783135697.679138:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1783135697.679236:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1783135697.679253:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1783135697.679269:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1783135697.679284:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1783135697.679300:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1783135697.679315:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1783135697.679329:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1783135697.679404:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1783135697.679427:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1783135697.679456:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1783135697.679484:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1783135697.679564:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1783135697.679585:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1783135697.679599:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1783135697.679611:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1783135697.679642:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1783135697.679659:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1783135697.679672:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1783135697.679685:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1783135697.679698:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1783135697.679712:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1783135697.679763:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809210368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135697.679832:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135697.679895:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135697.679989:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809210368 00000100:00100000:2.0:1783135697.679998:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809210368 00000100:00100000:2.0:1783135697.680053:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135697.680063:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+15:17797:x1869752809210368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135697.680236:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+15:17797:x1869752809210368:12345-0@lo:502:mount.lustre.0 Request processed in 174us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135697.680244:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783135697.680649:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809210368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135697.680716:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1783135697.680728:0:17797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1783135697.681815:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135697.681834:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135697.681837:0:17801:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783135697.681843:0:17801:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1783135697.681846:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135697.681862:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8ac67e2d0000) 00000020:00000080:1.0:1783135697.681883:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1783135697.681888:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783135697.681963:0:17801:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783135697.681969:0:17801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628ee0beb 00000020:00000080:1.0:1783135697.682287:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783135697.682291:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135697.682294:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135697.682296:0:17801:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783135697.682298:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135697.682302:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135697.682303:0:17801:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1783135697.682306:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135697.682313:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8ac67e2d19c0) 00000020:00000080:1.0:1783135697.682323:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1783135697.682326:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783135697.682328:0:17801:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1783135697.682331:0:17801:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1783135697.682336:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783135697.682827:0:17801:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac5424bf000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1783135697.682844:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8ac67c1699c0) 00000020:00000080:1.0:1783135697.682854:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1783135697.682920:0:17801:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783135697.682924:0:17801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628ee0c00 00000020:00000080:1.0:1783135697.683018:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1783135697.683024:0:17801:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783135697.683027:0:17801:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf7de4ef628ee0c07 00080000:01000000:1.0:1783135697.683032:0:17801:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783135697.683035:0:17801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628ee0c0e 00000100:00100000:3.0:1783135697.711143:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1783135697.814391:0:17801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1783135697.815004:0:17801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1783135697.815778:0:17801:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783135697.816704:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1783135697.816717:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135697.816723:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.816725:0:17801:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1783135697.816729:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135697.816734:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.816736:0:17801:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1783135697.816739:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783135697.816745:0:17801:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:00000080:0.0:1783135697.816773:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135697.816788:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8ac67e69b380) 00000020:00000080:0.0:1783135697.816808:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1783135697.816814:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783135697.816882:0:17801:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1783135697.816890:0:17801:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783135697.816898:0:17801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628ee0c1c 00010000:00080000:0.0:1783135697.816929:0:17801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac658084000@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.106@tcp at head 00010000:00010000:0.0:1783135697.818894:0:17801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1783135697.823627:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783135697.823644:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1783135697.823688:0:17801:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783135697.823713:0:17801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628ee0c23 00000100:00080000:0.0:1783135697.823724:0:17801:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135697.823730:0:17801:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ac658084000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135697.823765:0:17801:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438adc00 x1869752809210496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135697.824525:0:17801:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783135697.824629:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809210496:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783135697.824722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135697.825313:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809210496 00000100:00100000:1.0:1783135697.825328:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809210496 00000100:00100000:1.0:1783135697.825381:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135697.825388:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1869752809210496:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783135697.825414:0:17069:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:1.0:1783135697.825448:0:17069:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628ee0c2a 00000004:00100000:1.0:1783135697.825463:0:17069:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:0.0:1783135697.827724:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135697.827733:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.827736:0:17801:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1783135697.827740:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783135697.827743:0:17801:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1783135697.827744:0:17801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783135697.827746:0:17801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783135697.827748:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783135697.827750:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.827751:0:17801:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783135697.827754:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135697.827759:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.827760:0:17801:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1783135697.827764:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783135697.827817:0:17801:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783135697.827830:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135697.827833:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.827835:0:17801:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1783135697.827837:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783135697.827839:0:17801:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1783135697.827840:0:17801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783135697.827841:0:17801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783135697.827843:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783135697.827845:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.827846:0:17801:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783135697.827849:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783135697.827852:0:17801:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1783135697.827855:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.827856:0:17801:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783135697.827859:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783135697.827863:0:17801:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:0.0:1783135697.827903:0:17801:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1783135697.827906:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135697.827924:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8ac67e6999c0) 00000020:00000080:0.0:1783135697.827941:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1783135697.827948:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783135697.828161:0:17801:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1783135697.828168:0:17801:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783135697.828175:0:17801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628ee0c38 00010000:00080000:0.0:1783135697.828236:0:17801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac67f83f000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.106@tcp at head 00010000:00010000:0.0:1783135697.830692:0:17801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:2.0:1783135697.832410:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783135697.832419:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783135697.832424:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135697.832433:0:8:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 600 00000100:00080000:2.0:1783135697.832438:0:8:0:(import.c:591:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1783135697.832446:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ac660a3f800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135697.832624:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438b3100 x1869752809210624/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135697.832655:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135697.832667:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135697.832670:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135697.832674:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135697.832737:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809210752:0@lo:400:kworker.0 00000100:00100000:2.0:1783135697.832887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135697.832954:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809210752 00000100:00100000:2.0:1783135697.832962:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809210752 00000100:00100000:2.0:1783135697.833067:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135697.833077:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809210752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135697.833221:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809210752:12345-0@lo:400:kworker.0 Request processed in 144us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135697.833229:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783135697.833481:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ac5438b0e00 x1869752809210752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135697.833498:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809210752:0@lo:400:kworker.0 00000100:00100000:2.0:1783135697.833537:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809210624:0@lo:38:kworker.0 00000100:00100000:2.0:1783135697.833573:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135697.833605:0:17070:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1783135697.833614:0:17070:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1783135697.833711:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809210624 00000100:00100000:2.0:1783135697.833715:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809210624 00000100:00100000:2.0:1783135697.834008:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135697.834014:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869752809210624:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1783135697.834067:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869752809210624:12345-0@lo:38:kworker.0 Request processed in 51us (493us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783135697.834084:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135697.834201:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135697.834209:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135697.834213:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783135697.834217:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809210624:0@lo:38:kworker.0 00000001:00000004:1.0:1783135697.834839:0:17069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:0.0:1783135697.837711:0:17801:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783135697.843759:0:17801:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1783135697.854771:0:17801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135697.855591:0:17801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1783135697.855742:0:17801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1783135697.858188:0:17807:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783135697.858195:0:17807:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783135697.859158:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783135697.859171:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783135697.859211:0:17801:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783135697.859233:0:17801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628ee0c3f 00000100:00080000:3.0:1783135697.859244:0:17801:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135697.859250:0:17801:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ac67f83f000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135697.859290:0:17801:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67f84f100 x1869752809210880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135697.859314:0:17801:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1783135697.859702:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135697.859707:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135697.859709:0:17801:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783135697.859712:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783135697.859715:0:17801:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1783135697.859716:0:17801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135697.859718:0:17801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135697.859719:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783135697.859721:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135697.859723:0:17801:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783135697.859725:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783135697.859729:0:17801:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1783135697.859732:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135697.859734:0:17801:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783135697.859737:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783135697.859741:0:17801:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:3.0:1783135697.859764:0:17801:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1783135697.859767:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135697.859779:0:17801:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8ac658014d40) 00000020:00000080:3.0:1783135697.859792:0:17801:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1783135697.859797:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783135697.859856:0:17801:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1783135697.859864:0:17801:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783135697.859870:0:17801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf7de4ef628ee0c4d 00010000:00080000:3.0:1783135697.859900:0:17801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac64b2cb800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.106@tcp at head 00010000:00010000:3.0:1783135697.860132:0:17801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1783135697.860200:0:17801:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783135697.860216:0:17801:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1783135697.860405:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135697.860410:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135697.860413:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135697.860416:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135697.864217:0:17069:0:(import.c:65:import_set_state_nolock()) ffff8ac647217000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135697.864317:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869752809210496:12345-0@lo:38:llog_process_th.0 Request processed in 38925us (39593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135697.864329:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:3.0:1783135697.866982:0:17801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135697.867324:0:17801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1783135697.867516:0:17801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:2.0:1783135697.868067:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809210880:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783135697.868482:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752809210880 offset 0 length 520: 4 00000100:00100000:2.0:1783135697.868894:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135697.868907:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1783135697.868916:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783135697.868922:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783135697.868926:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac658084000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783135697.868943:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809210496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783135697.869025:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809211008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135697.869062:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135697.869133:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809211008 00000100:00100000:2.0:1783135697.869139:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809211008 00000100:00100000:2.0:1783135697.869180:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135697.869190:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1869752809211008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135697.869229:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135697.869273:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1869752809211008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135697.869280:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135697.869329:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809211008:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1783135697.876959:0:17809:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783135697.876972:0:17809:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783135697.878003:0:17801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1783135697.878018:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783135697.878060:0:17801:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783135697.878121:0:17801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628ee0c54 00000100:00080000:2.0:1783135697.878132:0:17801:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135697.878138:0:17801:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ac64b2cb800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135697.878173:0:17801:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438b3100 x1869752809211136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135697.878204:0:17801:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783135697.878262:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135697.878267:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135697.878269:0:17801:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783135697.878272:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135697.878276:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135697.878277:0:17801:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135697.878280:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135697.878281:0:17801:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783135697.878283:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135697.878286:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135697.878287:0:17801:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783135697.878290:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135697.878292:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135697.878293:0:17801:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783135697.878296:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783135697.878324:0:17801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135697.878327:0:17801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135697.878329:0:17801:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783135697.878331:0:17801:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:1.0:1783135697.878526:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135697.878531:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135697.878534:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135697.878537:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1783135697.878969:0:17797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1783135697.879004:0:17797:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1783135697.879029:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628ee0bd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0bdd expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135697.879040:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c526c00/0xf7de4ef628ee0bd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0bdd expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135697.879048:0:17797:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac5424bf000 from 1 10000000:01000000:1.0:1783135697.879062:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783135697.879129:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135697.879138:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135697.879149:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135697.879171:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135697.879243:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135697.879286:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cd780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135697.879615:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809211264 00000100:00100000:3.0:1783135697.879624:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809211264 00000100:00100000:3.0:1783135697.879675:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135697.879685:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+15:17797:x1869752809211264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135697.879702:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135697.879716:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527800/0xf7de4ef628ee0c62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0c5b expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.879743:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527800/0xf7de4ef628ee0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0c5b expref: 16 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.879754:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527800/0xf7de4ef628ee0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0c5b expref: 16 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135697.879764:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527800, rc 0) 00000100:00100000:3.0:1783135697.879809:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+16:17797:x1869752809211264:12345-0@lo:101:mount.lustre.0 Request processed in 125us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135697.879816:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783135697.880057:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135697.880076:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135697.880116:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135697.881023:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211392:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783135697.881222:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135697.881319:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809211136:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783135697.881369:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752809211136 offset 0 length 520: 4 00000100:00100000:1.0:1783135697.881654:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cd780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135697.883167:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809211392 00000100:00100000:3.0:1783135697.883182:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809211392 00000100:00100000:3.0:1783135697.883244:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783135697.883253:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+16:17797:x1869752809211392:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1783135697.883280:0:17056:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783135697.883306:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783135697.883310:0:17056:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1783135697.884003:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+16:17797:x1869752809211392:12345-0@lo:256:mount.lustre.0 Request processed in 749us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135697.884020:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783135697.891998:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211392:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783135697.893590:0:17797:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135697.893627:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135697.893657:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135697.899659:0:17797:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac5424bf000 from 1 10000000:01000000:0.0:1783135697.899669:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135697.899719:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135697.899732:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135697.899742:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135697.899785:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211520:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135697.899862:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135697.901539:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135697.903939:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809211520 00000100:00100000:1.0:1783135697.903955:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809211520 00000100:00100000:2.0:1783135697.907773:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783135697.907789:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+16:17797:x1869752809211520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135697.907821:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135697.907840:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0c70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0c69 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135697.907871:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0c69 expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135697.907885:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0c69 expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135697.907893:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909000, rc 0) 00000100:00100000:2.0:1783135697.907985:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17797:x1869752809211520:12345-0@lo:101:mount.lustre.0 Request processed in 199us (8122us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135697.907993:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783135697.908275:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135697.908296:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135697.908305:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135697.908475:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135697.908768:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135697.908813:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135697.908862:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cd480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135697.909252:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809211648 00000100:00100000:0.0:1783135697.909260:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809211648 00000100:00100000:0.0:1783135697.909310:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783135697.909320:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17797:x1869752809211648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135697.909591:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17797:x1869752809211648:12345-0@lo:501:mount.lustre.0 Request processed in 272us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135697.909599:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783135697.909693:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135697.909728:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135697.909775:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135697.909810:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cd480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135697.909870:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809211776 00000100:00100000:2.0:1783135697.909875:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809211776 00000100:00100000:2.0:1783135697.909917:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135697.909925:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17797:x1869752809211776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135697.910009:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17797:x1869752809211776:12345-0@lo:503:mount.lustre.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135697.910015:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135697.910616:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783135697.913166:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135697.913269:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135697.913371:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135697.913423:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cd780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135697.913726:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809211904 00000100:00100000:2.0:1783135697.913735:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809211904 00000100:00100000:2.0:1783135697.913781:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135697.913790:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17797:x1869752809211904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135697.913916:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17797:x1869752809211904:12345-0@lo:502:mount.lustre.0 Request processed in 127us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135697.913934:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135697.915010:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809211904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135697.915712:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783135697.915749:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1783135697.915766:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1783135697.915800:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1783135697.915817:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1783135697.915830:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1783135697.915843:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1783135697.915856:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1783135697.915868:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783135697.915880:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1783135697.915894:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1783135697.915936:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135697.916007:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135697.916053:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135697.916505:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809212032 00000100:00100000:1.0:1783135697.916514:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809212032 00000100:00100000:1.0:1783135697.916582:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783135697.916591:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17797:x1869752809212032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135697.916727:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17797:x1869752809212032:12345-0@lo:502:mount.lustre.0 Request processed in 136us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135697.916735:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783135697.916941:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135697.917014:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1783135697.917035:0:17797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1783135697.917830:0:17811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135697.917842:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.917845:0:17811:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783135697.917852:0:17811:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac5424bf000 00000020:00000080:0.0:1783135697.917855:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135697.917864:0:17811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135697.917866:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.917868:0:17811:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783135697.917870:0:17811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135697.917873:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.917874:0:17811:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783135697.917877:0:17811:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac5424bf000 00000020:00000080:0.0:1783135697.917880:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135697.918013:0:17811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135697.918018:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.918019:0:17811:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783135697.918022:0:17811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135697.918025:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.918026:0:17811:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783135697.918029:0:17811:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac5424bf000 00000020:00000080:0.0:1783135697.918031:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135697.934240:0:17811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135697.934254:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.934256:0:17811:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783135697.934261:0:17811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135697.934266:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.934267:0:17811:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783135697.934273:0:17811:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac5424bf000 00000020:00000080:0.0:1783135697.934275:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135697.934359:0:17811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135697.934363:0:17811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135697.934365:0:17811:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783135697.934368:0:17811:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1783135697.940318:0:17797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783135697.942478:0:17797:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135697.942510:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135697.942523:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135697.942582:0:17797:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783135697.942584:0:17797:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ac5424bf000 10000000:01000000:2.0:1783135697.942587:0:17797:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ac5424bf000 10000000:01000000:2.0:1783135697.942591:0:17797:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135697.942597:0:17797:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac5424bf000 from 1 10000000:01000000:2.0:1783135697.942599:0:17797:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135697.942634:0:17797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67f909400/0xf7de4ef628ee0c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135697.942642:0:17797:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67f909400/0xf7de4ef628ee0c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135697.942653:0:17797:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67f909400/0xf7de4ef628ee0c77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135697.942677:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135697.942736:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135697.942774:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543987840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135697.942804:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809212160 00000100:00100000:2.0:1783135697.942811:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809212160 00000100:00100000:2.0:1783135697.942865:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135697.942873:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e205450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17797:x1869752809212160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135697.942886:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135697.942897:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67f908800/0xf7de4ef628ee0c7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0c77 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135697.942919:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67f908800/0xf7de4ef628ee0c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0c77 expref: 18 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135697.942928:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67f908800/0xf7de4ef628ee0c7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0c77 expref: 18 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135697.942937:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f908800, rc 0) 00000100:00100000:2.0:1783135697.942970:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e205450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212160:12345-0@lo:101:mount.lustre.0 Request processed in 97us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135697.942977:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135697.943021:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135697.943033:0:17797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67f909400/0xf7de4ef628ee0c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0c7e expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135697.943042:0:17797:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67f909400/0xf7de4ef628ee0c77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0c7e expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135697.956707:0:17797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1783135697.957059:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135697.965750:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1783135697.965808:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1783135697.965826:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1783135697.965840:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1783135697.965853:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1783135697.965865:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1783135697.965878:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1783135697.965892:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1783135697.965907:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1783135697.965919:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1783135697.965931:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1783135697.965942:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1783135697.965953:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1783135697.965964:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1783135697.965975:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1783135697.965986:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1783135697.965997:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1783135697.966007:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1783135697.966018:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1783135697.966028:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1783135697.966039:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1783135697.966049:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1783135697.966075:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1783135697.966108:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1783135697.966122:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1783135697.966133:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1783135697.966148:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1783135697.966159:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1783135697.966182:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1783135697.966187:0:17797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1783135697.966288:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135697.966365:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135697.966416:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135697.966688:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809212288 00000100:00100000:3.0:1783135697.966695:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809212288 00000100:00100000:3.0:1783135697.966748:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783135697.966757:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e204050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135697.966893:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e204050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212288:12345-0@lo:501:mount.lustre.0 Request processed in 136us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135697.966900:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783135697.967706:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135697.967756:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135697.967816:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135697.967851:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809212416 00000100:00100000:0.0:1783135697.967860:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809212416 00000100:00100000:0.0:1783135697.967904:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783135697.967913:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212416:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135697.968004:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212416:12345-0@lo:503:mount.lustre.0 Request processed in 90us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135697.968011:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783135697.968050:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135697.968063:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212416:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783135697.975333:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135697.975456:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135697.975670:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135697.975713:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135697.975798:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809212544 00000100:00100000:1.0:1783135697.975806:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809212544 00000100:00100000:1.0:1783135697.975864:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783135697.975875:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e205c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135697.976002:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e205c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212544:12345-0@lo:502:mount.lustre.0 Request processed in 127us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135697.976010:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783135697.976070:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212544:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135697.976418:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1783135697.976448:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1783135697.976461:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1783135697.976490:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1783135697.976581:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1783135697.976599:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1783135697.976612:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1783135697.976624:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1783135697.976635:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1783135697.976646:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1783135697.976657:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1783135697.976681:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1783135697.976696:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1783135697.976730:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1783135697.976744:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1783135697.976756:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1783135697.976768:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1783135697.977131:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1783135697.977158:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1783135697.977172:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1783135697.977185:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1783135697.977198:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1783135697.977212:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1783135697.977224:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1783135697.977237:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1783135697.977250:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1783135697.977263:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1783135697.977276:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1783135697.977289:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1783135697.977319:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1783135697.977335:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1783135697.977964:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1783135697.977996:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1783135697.978010:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1783135697.978022:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1783135697.978034:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1783135697.978046:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1783135697.978072:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1783135697.978169:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1783135697.978187:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1783135697.978200:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1783135697.978214:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1783135697.978224:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1783135697.978237:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1783135697.978269:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1783135697.978297:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1783135697.978313:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1783135697.978327:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1783135697.978595:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135697.978674:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135697.978761:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672d42d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135697.984135:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809212672 00000100:00100000:3.0:1783135697.984150:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809212672 00000100:00100000:2.0:1783135697.984303:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783135697.984315:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135697.984533:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212672:12345-0@lo:502:mount.lustre.0 Request processed in 220us (5858us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135697.984547:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783135697.984750:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135697.984978:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1783135697.985009:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1783135697.985046:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135697.985140:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135697.985178:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809212800 00000100:00100000:3.0:1783135697.985183:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809212800 00000100:00100000:3.0:1783135697.985215:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783135697.985222:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135697.985299:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809212800:12345-0@lo:502:mount.lustre.0 Request processed in 76us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135697.985307:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783135697.985374:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642daca80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135697.985388:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809212800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135697.985426:0:17797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1783135697.985440:0:17797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783135697.988871:0:17817:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1783135697.988893:0:17817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8ac67e69cd40) 00000020:00000080:0.0:1783135697.988917:0:17817:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1783135697.989109:0:17817:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac5424bf000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783135697.989114:0:17817:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac5424bf000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783135697.989117:0:17817:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac5424bf000 3 00010000:00080000:0.0:1783135697.989148:0:17817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac649bdb800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.106@tcp at head 00010000:00010000:0.0:1783135697.993895:0:17817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1783135697.994008:0:17817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783135697.994057:0:17817:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783135697.994077:0:17817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf7de4ef628ee0c8c 00000100:00080000:0.0:1783135697.994126:0:17817:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135697.994134:0:17817:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ac649bdb800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135697.994171:0:17817:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438ac000 x1869752809212928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135697.994198:0:17817:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783135697.994909:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869752809212928:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135697.994987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783135697.995057:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135697.995061:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135697.995064:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135697.995067:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783135697.995249:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809212928 00000100:00100000:3.0:1783135697.995257:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809212928 00000100:00100000:3.0:1783135697.995303:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135697.995311:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1869752809212928:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783135697.995338:0:17065:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:3.0:1783135697.995485:0:17065:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf7de4ef628ee0c93 00000004:00100000:3.0:1783135697.995565:0:17065:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783135697.995604:0:17065:0:(import.c:65:import_set_state_nolock()) ffff8ac642c33800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135697.995667:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1869752809212928:12345-0@lo:38:llog_process_th.0 Request processed in 354us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135697.995675:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783135697.995720:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ac5438ac000 x1869752809212928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135697.995731:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135697.995739:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1783135697.995745:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783135697.995750:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783135697.995752:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac649bdb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783135697.995758:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1869752809212928:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1783135697.996315:0:17817:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1783135698.004214:0:17797:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783135698.004263:0:17797:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135698.004324:0:17797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67f909400/0xf7de4ef628ee0c77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0c7e expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135698.004337:0:17797:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67f909400/0xf7de4ef628ee0c77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0c7e expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783135698.004397:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783135698.004399:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783135698.004400:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135698.004401:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135698.004402:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135698.004403:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135698.004405:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135698.004407:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135698.004408:0:17797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135698.004412:0:17797:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1783135698.004415:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135698.004416:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783135698.004417:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135698.004418:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135698.004419:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135698.004420:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135698.004421:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135698.004422:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135698.004423:0:17797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135698.004453:0:17797:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783135698.004527:0:17797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809213056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783135698.004615:0:17797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135698.004656:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809213056 00000100:00100000:3.0:1783135698.004663:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809213056 00000100:00100000:3.0:1783135698.004709:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783135698.004718:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e207050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809213056:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135698.004748:0:17056:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783135698.004764:0:17056:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783135698.009362:0:17797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642daca80 going to sleep for 11 seconds 00000001:00100000:3.0:1783135698.010006:0:17044:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1783135698.010420:0:17056:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783135698.010476:0:17056:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1783135698.010942:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e207050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17797:x1869752809213056:12345-0@lo:253:mount.lustre.0 Request processed in 6219us (6321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135698.010956:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783135698.011063:0:17797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17797:1869752809213056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135698.011077:0:17797:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1783135698.011080:0:17797:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135698.011082:0:17797:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1783135698.011083:0:17797:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135698.011115:0:17797:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135698.011117:0:17797:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135698.011118:0:17797:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135698.011120:0:17797:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135698.011122:0:17797:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135698.011123:0:17797:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783135698.011140:0:17797:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1783135698.015408:0:17080:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783135698.015420:0:17080:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783135698.015444:0:17080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135698.015477:0:17080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac682172800/0xf7de4ef628ee0b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b97 expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135698.015484:0:17080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c527800/0xf7de4ef628ee0c62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0c5b expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135698.015492:0:17080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135698.015618:0:17080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c527800/0xf7de4ef628ee0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0c5b expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135698.015633:0:17080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67c527800/0xf7de4ef628ee0c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0c5b expref: 17 pid: 17058 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135698.015650:0:17080:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809213184:0@lo:104: 00000100:00100000:3.0:1783135698.015720:0:17080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135698.015914:0:17080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac682172800/0xf7de4ef628ee0b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0b97 expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135698.015923:0:17080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac682172800/0xf7de4ef628ee0b9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b97 expref: 17 pid: 17059 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135698.015931:0:17080:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809213312:0@lo:104: 00000100:00100000:3.0:1783135698.015952:0:17080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135698.016880:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809213184 00000100:00100000:0.0:1783135698.016891:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809213184 00000100:00100000:3.0:1783135698.016894:0:17080:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac642dac840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135698.016930:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809213312 00000100:00100000:0.0:1783135698.016933:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809213312 00000100:00100000:0.0:1783135698.016947:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135698.016955:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:17080:x1869752809213184:12345-0@lo:104: 00010000:00010000:0.0:1783135698.016971:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017031:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135698.017036:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:17080:x1869752809213184:12345-0@lo:104: Request processed in 82us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135698.017044:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135698.017061:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135698.017067:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:17080:x1869752809213312:12345-0@lo:104: 00010000:00010000:0.0:1783135698.017074:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017150:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783135698.017155:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:17080:x1869752809213312:12345-0@lo:104: Request processed in 89us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135698.017161:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783135698.017177:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135698.017183:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017190:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20fe00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135698.017194:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017203:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135698.017210:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135698.017215:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135698.017247:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017253:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135698.017274:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017282:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fe00/0xf7de4ef628ee0c5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0c62 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017301:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135698.017305:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017311:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f800 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135698.017313:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017320:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135698.017595:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135698.017602:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135698.017619:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017625:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135698.017806:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017813:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f800/0xf7de4ef628ee0b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0b9e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135698.017871:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135698.017873:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135698.017874:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135698.017883:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135698.017909:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809213440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135698.017948:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135698.017987:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135698.017992:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809213568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135698.018014:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135698.018073:0:17080:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809213184:0@lo:104: 00000100:00100000:0.0:1783135698.018082:0:17080:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809213312:0@lo:104: 00010000:00010000:0.0:1783135698.018122:0:17080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135698.018144:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809213440 00000100:00100000:1.0:1783135698.018150:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809213440 00010000:00010000:1.0:1783135698.018175:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c527800/0xf7de4ef628ee0c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0c5b expref: 18 pid: 17058 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135698.018207:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809213568 00000100:00100000:1.0:1783135698.018211:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809213568 00010000:00010000:1.0:1783135698.018222:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac682172800/0xf7de4ef628ee0b9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b97 expref: 19 pid: 17059 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135698.018236:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135698.018243:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:3648:x1869752809213440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135698.018253:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135698.018264:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c527800/0xf7de4ef628ee0c62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0c5b expref: 19 pid: 17058 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018275:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c527800/0xf7de4ef628ee0c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0c5b expref: 19 pid: 17058 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018294:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527800/0xf7de4ef628ee0c62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0c5b expref: 19 pid: 17058 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018308:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135698.018352:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:3648:x1869752809213440:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135698.018359:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135698.018374:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135698.018380:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:3648:x1869752809213568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135698.018387:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135698.018392:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac682172800/0xf7de4ef628ee0b9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b97 expref: 17 pid: 17059 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018401:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac682172800/0xf7de4ef628ee0b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b97 expref: 17 pid: 17059 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018410:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac682172800/0xf7de4ef628ee0b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0b97 expref: 17 pid: 17059 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018422:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135698.018430:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809213440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135698.018430:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783135698.018453:0:17050:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005476921s 00010000:00010000:1.0:1783135698.018458:0:17050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018475:0:17050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018481:0:17050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018487:0:17050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018493:0:17050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527a00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135698.018565:0:17050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018574:0:17050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018596:0:17050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135698.018605:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135698.018631:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+16:3648:x1869752809213568:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135698.018638:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135698.020253:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809213568:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135698.020286:0:17080:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135698.020296:0:17080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135698.020303:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527a00/0xf7de4ef628ee0c9a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1783135698.023251:0:17797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1783135698.023646:0:17823:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1783135698.024127:0:17823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1783135698.025434:0:17797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1783135698.026476:0:17824:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1869752809213696:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1783135698.026742:0:17797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1783135698.026784:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783135698.027308:0:17797:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783135698.027325:0:17797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1783135698.027443:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135698.028793:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135698.028838:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809213696 00000100:00100000:1.0:1783135698.028845:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809213696 00000100:00100000:1.0:1783135698.028904:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135698.028914:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17824:x1869752809213696:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783135698.029005:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17824:x1869752809213696:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 93us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135698.029013:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135698.029040:0:17824:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac641254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135698.029063:0:17824:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1869752809213696:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1783135698.029118:0:17824:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783135698.029179:0:17824:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1869752809213824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783135698.029212:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135698.029229:0:17824:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7000 going to sleep for 11 seconds 00000020:00080000:2.0:1783135698.030620:0:17822:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1783135698.030631:0:17822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783135698.031145:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809213824 00000100:00100000:2.0:1783135698.031157:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809213824 00000100:00100000:2.0:1783135698.031218:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135698.031228:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17824:x1869752809213824:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783135698.031446:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17824:x1869752809213824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 219us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135698.031454:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135698.031720:0:17824:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1869752809213824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783135698.031832:0:17824:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17824:1869752809213952:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783135698.031871:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135698.031897:0:17824:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135698.032652:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809213952 00000100:00100000:2.0:1783135698.032660:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809213952 00000100:00100000:2.0:1783135698.032699:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135698.032708:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17824:x1869752809213952:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1783135698.032765:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17824:x1869752809213952:12345-0@lo:900:lod0001_rec0000.0 Request processed in 59us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135698.032773:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1783135698.033252:0:17823:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783135698.033324:0:17823:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00010000:00080000:1.0:1783135698.033622:0:17824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ac67b3b3800 x1869752809213952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783135714 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135698.033638:0:17824:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17824:1869752809213952:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1783135698.033714:0:17824:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1869752809214080:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1783135698.033755:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135698.033776:0:17824:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7000 going to sleep for 11 seconds 00000040:00080000:3.0:1783135698.034003:0:17797:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1783135698.034494:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809214080 00000100:00100000:2.0:1783135698.034565:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809214080 00000100:00100000:2.0:1783135698.034612:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135698.034622:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17824:x1869752809214080:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783135698.034732:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17824:x1869752809214080:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135698.034739:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135698.035065:0:17824:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17824:1869752809214080:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1783135698.035169:0:17824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135698.035878:0:17797:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783135698.035935:0:17797:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1783135698.036174:0:17797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783135698.041808:0:17797:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1783135698.044263:0:17824:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783135698.044345:0:17824:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783135698.044610:0:17824:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1783135698.047167:0:17797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1783135698.049521:0:17797:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783135698.049567:0:17797:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa3f9c1ca3988 00100000:10000000:1.0:1783135698.049577:0:17797:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1783135698.053276:0:17797:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783135698.053315:0:17797:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783135698.053334:0:17797:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1783135698.053359:0:17797:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1783135698.060184:0:17797:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135698.064173:0:17797:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783135698.299202:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135698.735690:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00000040:00080000:0.0:1783135699.054733:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135699.310316:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783135699.566216:0:17061:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783135699.566226:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac5424bf000 from 8 10000000:01000000:0.0:1783135699.566232:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135699.566285:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135699.566298:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135699.566309:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135699.566354:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809214208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135699.566446:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135699.566526:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135699.566602:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809214208 00000100:00100000:1.0:1783135699.566609:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809214208 00000100:00100000:1.0:1783135699.566666:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783135699.566676:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e206850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+16:17061:x1869752809214208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135699.566693:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135699.566707:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20ec00/0xf7de4ef628ee0ca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0ca1 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135699.566732:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20ec00/0xf7de4ef628ee0ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ca1 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135699.566743:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20ec00/0xf7de4ef628ee0ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ca1 expref: 17 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135699.566752:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20ec00, rc 0) 00000100:00100000:1.0:1783135699.566806:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e206850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17061:x1869752809214208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135699.566813:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783135699.569269:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809214208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135699.569300:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135699.569313:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135699.569391:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809214336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783135699.569465:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135699.569522:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135699.569613:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809214336 00000100:00100000:1.0:1783135699.569620:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809214336 00000100:00100000:1.0:1783135699.569680:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783135699.569689:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17061:x1869752809214336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783135699.569708:0:17056:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135699.569726:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135699.569729:0:17056:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1783135699.569841:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17061:x1869752809214336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135699.569850:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135699.570049:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809214336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783135699.570123:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135699.570131:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135699.570140:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135699.570149:0:17061:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783135699.570158:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac678352000 from 8 10000000:01000000:2.0:1783135699.570162:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135699.570188:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135699.570197:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135699.570205:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135699.570221:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809214464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135699.570261:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135699.570290:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac649362000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135699.570581:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809214464 00000100:00100000:1.0:1783135699.570586:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809214464 00000100:00100000:1.0:1783135699.570610:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135699.570616:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17061:x1869752809214464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135699.570626:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135699.570638:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0cb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0caf expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135699.570656:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0caf expref: 18 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135699.570665:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0caf expref: 18 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135699.570673:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f600, rc 0) 00000100:00100000:1.0:1783135699.570711:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17061:x1869752809214464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135699.570717:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783135699.570808:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809214464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135699.570819:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135699.570827:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135699.570867:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809214592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783135699.570894:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135699.570914:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac649362000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135699.571059:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809214592 00000100:00100000:1.0:1783135699.571064:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809214592 00000100:00100000:1.0:1783135699.571083:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783135699.571119:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e205050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17061:x1869752809214592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783135699.571131:0:17056:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135699.571143:0:17056:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135699.571146:0:17056:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1783135699.571208:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e205050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17061:x1869752809214592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135699.571215:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783135699.571316:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809214592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783135699.571356:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135699.571362:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135699.571378:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135699.772284:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00000040:00080000:0.0:1783135700.081796:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783135700.339033:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135700.787294:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:3.0:1783135701.377779:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135701.806233:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00010000:00010000:2.0:1783135702.391606:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135702.830847:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 0 seconds 00000100:00100000:2.0:1783135702.895744:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809214720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135702.896194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135702.896757:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809214720 00000100:00100000:1.0:1783135702.896767:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809214720 00000100:00100000:1.0:1783135702.897984:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135702.897998:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809214720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783135702.898039:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783135702.898139:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809214720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135702.898146:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135702.898550:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809214720:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1783135703.410878:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783135703.410889:0:13713:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783135703.410893:0:13713:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135703.410909:0:13713:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ac660a3f800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135703.410937:0:13713:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438b2a00 x1869752809214976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135703.410957:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135703.410962:0:13713:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135703.410965:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135703.410967:0:13713:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135703.410996:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135703.410999:0:13713:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135703.411002:0:13713:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135703.411005:0:13713:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135703.411044:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3647:1869752809214848:0@lo:400:kworker.0 00000100:00100000:2.0:1783135703.411185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135703.411255:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135703.411263:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809215360:0@lo:400:kworker.0 00000100:00100000:2.0:1783135703.411331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135703.411380:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809214976:0@lo:38:kworker.0 00000100:00100000:2.0:1783135703.411415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135703.411447:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809215104:0@lo:400:kworker.0 00000100:00100000:2.0:1783135703.411471:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135703.411490:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135703.411495:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809215232:0@lo:400:kworker.0 00000100:00100000:2.0:1783135703.411518:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135703.411552:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809214848 00000100:00100000:2.0:1783135703.411560:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809214848 00000100:00100000:2.0:1783135703.411614:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135703.411624:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:3647:x1869752809214848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135703.411697:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:3647:x1869752809214848:12345-0@lo:400:kworker.0 Request processed in 74us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135703.411705:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135703.411750:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809215360 00000100:00100000:2.0:1783135703.411755:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809215360 00000100:00100000:2.0:1783135703.411781:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809215104 00000100:00100000:2.0:1783135703.411784:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809215104 00000100:00100000:2.0:1783135703.411806:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135703.411813:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809215360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135703.411850:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809215360:12345-0@lo:400:kworker.0 Request processed in 37us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135703.411857:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135703.411878:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135703.411884:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809215104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135703.411919:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809215104:12345-0@lo:400:kworker.0 Request processed in 35us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135703.411925:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135703.411943:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809214976 00000100:00100000:2.0:1783135703.411947:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809214976 00000100:00100000:2.0:1783135703.411966:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809215232 00000100:00100000:2.0:1783135703.411969:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809215232 00000100:00100000:2.0:1783135703.411985:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135703.411990:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1869752809214976:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783135703.412018:0:17806:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:2.0:1783135703.412063:0:17806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628ee0cbd 00000004:00100000:2.0:1783135703.412081:0:17806:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1783135703.412111:0:17806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1783135703.412207:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135703.412216:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809215232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135703.412249:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809215232:12345-0@lo:400:kworker.0 Request processed in 35us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135703.412255:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783135703.412313:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac5438b1180 x1869752809215360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135703.412327:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809215360:0@lo:400:kworker.0 00000100:00100000:2.0:1783135703.412337:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3647:1869752809214848:0@lo:400:kworker.0 00000100:00100000:2.0:1783135703.412383:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809215232:0@lo:400:kworker.0 00010000:00080000:2.0:1783135703.412401:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac5438b2680 x1869752809215104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135703.412410:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809215104:0@lo:400:kworker.0 00010000:00010000:3.0:1783135703.419434:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783135703.426301:0:17806:0:(import.c:65:import_set_state_nolock()) ffff8ac647f9a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135703.426431:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1869752809214976:12345-0@lo:38:kworker.0 Request processed in 14436us (15013us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135703.426448:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1783135703.442045:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783135703.442066:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1783135703.442074:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783135703.442079:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac660a3f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1783135703.442140:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005a8caed6): req@ffff8ac5438adf80 x1869752809207552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135703.442166:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809214976:0@lo:38:kworker.0 00000100:00100000:2.0:1783135703.442299:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135703.442335:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6743cdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135703.442348:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135703.442350:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809207552 00000100:00100000:3.0:1783135703.442359:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809207552 00000100:00100000:2.0:1783135703.442373:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809215488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135703.442397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135703.442422:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809215488 00000100:00100000:3.0:1783135703.442426:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809215488 00000100:00100000:2.0:1783135703.442428:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135703.442436:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17106:x1869752809207552:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783135703.442440:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135703.442445:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1869752809215488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135703.442472:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135703.442514:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1869752809215488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135703.442514:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17106:x1869752809207552:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135703.442521:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135703.443218:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809215488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135703.447970:0:17106:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17106:1869752809207552:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1783135703.448022:0:17106:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1783135703.448079:0:17106:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17106:1869752809215616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783135703.448159:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135703.448202:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135703.448222:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809215616 00000100:00100000:1.0:1783135703.448228:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809215616 00000100:00100000:2.0:1783135703.449462:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135703.455482:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135703.455503:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17106:x1869752809215616:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783135703.455743:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17106:x1869752809215616:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 249us (7582us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135703.455752:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135703.456330:0:17106:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17106:1869752809215616:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783135703.456476:0:17106:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17106:1869752809215744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783135703.456517:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135703.456550:0:17106:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135703.458296:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809215744 00000100:00100000:1.0:1783135703.458309:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809215744 00000100:00100000:1.0:1783135703.458388:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135703.458400:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17106:x1869752809215744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783135703.458525:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17106:x1869752809215744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 126us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135703.458533:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135703.458580:0:17106:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17106:1869752809215744:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1783135703.458647:0:17106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135703.475211:0:17106:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783135703.475301:0:17106:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:1.0:1783135703.475306:0:17106:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1783135703.797056:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1783135704.092465:0:18067:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783135704.431225:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135705.457545:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783135705.605861:0:18119:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135705.607039:0:18119:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783135706.479216:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135691/real 1783135691] req@ffff8ac5438af100 x1869752809208704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135706 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135706.479249:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac5438af100 x1869752809208704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135706 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135706.479259:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135691/real 1783135691] req@ffff8ac5438afb80 x1869752809208832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135706 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135706.479270:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac5438afb80 x1869752809208832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135706 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135706.479290:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac544115000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135706.479302:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135706.479315:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809208704:0@lo:8:kworker.0 00000100:00080000:2.0:1783135706.479321:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135706.479326:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135706.479329:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809208832:0@lo:8:kworker.0 00000100:00080000:1.0:1783135706.479795:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135706.479798:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783135706.479800:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac544115000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135706.479804:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:1.0:1783135706.479808:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783135706.479813:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ac544115000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135706.479829:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67b3b0380 x1869752809216128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135706.479856:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135706.479860:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135706.479861:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135706.479865:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:1.0:1783135706.479867:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783135706.479871:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ac67c3d0800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135706.479882:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67b3b2d80 x1869752809216256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135706.479914:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135706.479918:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135706.479920:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135706.479923:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783135706.479948:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809215872:0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.480015:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135706.480051:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809216640:0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.480078:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135706.480573:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135706.480581:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809216000:0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.480608:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135706.480646:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809216384:0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.480683:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135706.480701:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135706.480707:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809216512:0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.480736:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135706.480766:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809215872 00000100:00100000:1.0:1783135706.480774:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809215872 00000100:00100000:1.0:1783135706.480816:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135706.480826:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:3648:x1869752809215872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.480876:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:3648:x1869752809215872:12345-0@lo:400:kworker.0 Request processed in 51us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135706.480884:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135706.480921:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809216640 00000100:00100000:1.0:1783135706.480925:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809216640 00000100:00100000:1.0:1783135706.480945:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809216384 00000100:00100000:1.0:1783135706.480948:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809216384 00000100:00100000:1.0:1783135706.480964:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135706.480970:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809216640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.480999:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809216640:12345-0@lo:400:kworker.0 Request processed in 29us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135706.481010:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135706.481021:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135706.481027:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809216384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.481055:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809216384:12345-0@lo:400:kworker.0 Request processed in 29us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135706.481061:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135706.481079:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809216000 00000100:00100000:1.0:1783135706.481082:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809216000 00000100:00100000:1.0:1783135706.481139:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809216512 00000100:00100000:1.0:1783135706.481142:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809216512 00000100:00100000:1.0:1783135706.481155:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135706.481161:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809216000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.481199:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809216000:12345-0@lo:400:kworker.0 Request processed in 37us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135706.481205:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135706.481217:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135706.481223:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809216512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.481249:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809216512:12345-0@lo:400:kworker.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135706.481254:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135706.481295:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809216512:0@lo:400:kworker.0 00010000:00080000:1.0:1783135706.481317:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac67b3b1c00 x1869752809216384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135706.481326:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809216384:0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.481360:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809216000:0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.481369:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809215872:0@lo:400:kworker.0 00010000:00080000:1.0:1783135706.481377:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac67b3b0e00 x1869752809216640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135706.481385:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809216640:0@lo:400:kworker.0 00000100:00100000:1.0:1783135706.481407:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809216128:0@lo:8:kworker.0 00000400:00000100:1.0:1783135706.481433:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752809216128 offset 0 length 520: 4 00000100:00100000:1.0:1783135706.481455:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809216256:0@lo:8:kworker.0 00000400:00000100:1.0:1783135706.481473:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752809216256 offset 0 length 520: 4 00010000:00010000:3.0:1783135706.481998:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783135706.590008:0:18169:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135706.590758:0:18169:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783135707.502576:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135707.502895:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135697/real 1783135697] req@ffff8ac5438b3100 x1869752809211136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135707 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135707.502949:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac5438b3100 x1869752809211136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135707 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135707.502960:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135697/real 1783135697] req@ffff8ac67f84f100 x1869752809210880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135707 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135707.502971:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac67f84f100 x1869752809210880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135707 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135707.502993:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135707.503016:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783135707.503021:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809211136:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783135707.503026:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67f83f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135707.503031:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783135707.503033:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809210880:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1783135707.503319:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3649:1869752809216768:0@lo:400:kworker.0 00000100:00100000:1.0:1783135707.503874:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783135707.503964:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135707.503971:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135707.503973:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135707.503976:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135707.503999:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135707.504002:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783135707.504005:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac67f83f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135707.504018:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 601 00000100:00080000:0.0:1783135707.504023:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135707.504030:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ac67f83f000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135707.504050:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438af100 x1869752809217280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135707.504064:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135707.504067:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783135707.504068:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135707.504071:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 601 00000100:00080000:0.0:1783135707.504074:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135707.504077:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ac64b2cb800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1783135707.504113:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5438adf80 x1869752809217408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135707.504157:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809217152:0@lo:400:kworker.0 00000100:00100000:0.0:1783135707.504195:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135707.504231:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135707.504237:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809217536:0@lo:400:kworker.0 00000100:00100000:0.0:1783135707.504265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135707.504305:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809217152 00000100:00100000:0.0:1783135707.504313:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809217152 00000100:00100000:0.0:1783135707.504362:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783135707.504384:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809217152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135707.504452:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809217152:12345-0@lo:400:kworker.0 Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135707.504460:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783135707.504494:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809217536 00000100:00100000:0.0:1783135707.504498:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809217536 00000100:00100000:0.0:1783135707.504527:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135707.504533:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809217536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135707.504566:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809217536:12345-0@lo:400:kworker.0 Request processed in 33us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135707.504573:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783135707.504613:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac5438ac700 x1869752809217536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135707.504627:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809217536:0@lo:400:kworker.0 00000100:00100000:0.0:1783135707.504637:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809217152:0@lo:400:kworker.0 00000100:00100000:1.0:1783135707.506591:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809217024:0@lo:400:kworker.0 00000100:00100000:1.0:1783135707.506662:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135707.506687:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135707.506694:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809216896:0@lo:400:kworker.0 00000100:00100000:1.0:1783135707.506718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135707.506757:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809216896 00000100:00100000:1.0:1783135707.506764:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809216896 00000100:00100000:1.0:1783135707.506810:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135707.506819:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1869752809216896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135707.506887:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1869752809216896:12345-0@lo:400:kworker.0 Request processed in 69us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135707.506895:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135707.506939:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809216896:0@lo:400:kworker.0 00000100:00100000:1.0:1783135707.506969:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809217280:0@lo:8:kworker.0 00000400:00000100:1.0:1783135707.506998:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752809217280 offset 0 length 520: 4 00000100:00100000:1.0:1783135707.507012:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809217408:0@lo:8:kworker.0 00000400:00000100:1.0:1783135707.507030:0:3645:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752809217408 offset 0 length 520: 4 00000100:00100000:0.0:1783135707.507133:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809217024 00000100:00100000:0.0:1783135707.507138:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809217024 00000100:00100000:0.0:1783135707.507181:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135707.507189:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809217024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135707.507227:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1869752809217024:12345-0@lo:400:kworker.0 Request processed in 39us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135707.507233:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1783135707.507791:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac5438ace00 x1869752809217024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135707.507805:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1869752809217024:0@lo:400:kworker.0 00000100:00100000:2.0:1783135707.509633:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809216768 00000100:00100000:2.0:1783135707.509648:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809216768 00000100:00100000:2.0:1783135707.509720:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783135707.509731:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:3649:x1869752809216768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135707.509833:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:3649:x1869752809216768:12345-0@lo:400:kworker.0 Request processed in 104us (5961us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135707.509840:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783135707.510131:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3649:1869752809216768:0@lo:400:kworker.0 00000020:00000080:3.0:1783135707.680317:0:18218:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd11f5fe10 20000000:00000080:3.0:1783135707.680337:0:18218:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac675ea3000 uarg=0000000000000000 20000000:01000000:3.0:1783135707.680380:0:18218:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783135707.680386:0:18218:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783135707.680392:0:18218:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783135707.680819:0:18219:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1783135707.681061:0:18218:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783135707.686213:0:18218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783135707.686242:0:18218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.686263:0:18218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac682172400/0xf7de4ef628ee0b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0b66 expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.686271:0:18218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0c70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0c69 expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.686279:0:18218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.686406:0:18218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0c69 expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.686423:0:18218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0c69 expref: 17 pid: 17059 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135707.686455:0:18218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18218:1869752809217664:0@lo:104: 00000100:00100000:3.0:1783135707.686521:0:18218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135707.686650:0:18218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac682172400/0xf7de4ef628ee0b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0b66 expref: 17 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.686659:0:18218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac682172400/0xf7de4ef628ee0b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b66 expref: 17 pid: 17059 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135707.686667:0:18218:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18218:1869752809217792:0@lo:104: 00000100:00100000:3.0:1783135707.686692:0:18218:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135707.686855:0:18218:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135707.686898:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809217664 00000100:00100000:1.0:1783135707.686907:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809217664 00000100:00100000:0.0:1783135707.686965:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809217792 00000100:00100000:0.0:1783135707.686970:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809217792 00000100:00100000:0.0:1783135707.686994:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135707.687003:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:18218:x1869752809217664:12345-0@lo:104: 00010000:00010000:0.0:1783135707.687016:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135707.687112:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135707.687128:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:18218:x1869752809217664:12345-0@lo:104: Request processed in 125us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135707.687137:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135707.687151:0:18218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18218:1869752809217664:0@lo:104: 00000100:00100000:0.0:1783135707.687162:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135707.687170:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:18218:x1869752809217792:12345-0@lo:104: 00010000:00010000:0.0:1783135707.687178:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135707.687221:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783135707.687226:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:18218:x1869752809217792:12345-0@lo:104: Request processed in 58us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135707.687233:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135707.687239:0:18218:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18218:1869752809217792:0@lo:104: 00010000:00010000:0.0:1783135707.687254:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135707.687261:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.687264:0:18218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135707.687279:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989c00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135707.687298:0:17053:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135707.687308:0:17053:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135707.687427:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1783135707.687492:0:17053:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135707.687501:0:17053:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783135707.687572:0:17053:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135707.687589:0:17053:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135707.687613:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135707.687619:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac650989c00/0xf7de4ef628ee0c69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0c70 expref: -99 pid: 17797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135707.687632:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135707.687634:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135707.687635:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135707.687647:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809217920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135707.687678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135707.687720:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809217920 00000100:00100000:0.0:1783135707.687724:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809217920 00010000:00010000:0.0:1783135707.687743:0:17051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0c69 expref: 18 pid: 17059 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135707.687764:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135707.687770:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:3646:x1869752809217920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135707.687779:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135707.687784:0:17051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0c69 expref: 18 pid: 17059 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135707.687793:0:17051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0c69 expref: 18 pid: 17059 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135707.687807:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0c70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0c69 expref: 18 pid: 17059 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135707.687830:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135707.687857:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:3646:x1869752809217920:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135707.687863:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135707.687892:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809217920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135707.689049:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135707.689054:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135707.689057:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135707.689125:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689134:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac682172600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135707.689137:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689145:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135707.689151:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135707.689165:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783135707.689199:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689206:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135707.689227:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689233:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac682172600/0xf7de4ef628ee0b66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0b6d expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135707.689238:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3647:1869752809218048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135707.689250:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135707.689253:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135707.689255:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135707.689302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135707.689423:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809218048 00000100:00100000:3.0:1783135707.689430:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809218048 00010000:00010000:3.0:1783135707.689451:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac682172400/0xf7de4ef628ee0b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b66 expref: 17 pid: 17059 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135707.689493:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135707.689502:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:3647:x1869752809218048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135707.689513:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135707.689518:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac682172400/0xf7de4ef628ee0b6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b66 expref: 17 pid: 17059 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689527:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac682172400/0xf7de4ef628ee0b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0b66 expref: 17 pid: 17059 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689539:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac682172400/0xf7de4ef628ee0b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0b66 expref: 17 pid: 17059 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689558:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689566:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689580:0:17050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689586:0:17050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689592:0:17050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689598:0:17050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689602:0:17050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527000 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135707.689606:0:17050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689612:0:17050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689626:0:17050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689635:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135707.689669:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+16:3647:x1869752809218048:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135707.689681:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1783135707.689708:0:18218:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689717:0:18218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135707.689724:0:18218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527000/0xf7de4ef628ee0cc4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135707.690001:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3647:1869752809218048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135708.014332:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809218176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135708.014425:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135708.014531:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809218176 00000100:00100000:1.0:1783135708.014540:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809218176 00000100:00100000:1.0:1783135708.014600:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135708.014609:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809218176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783135708.014646:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783135708.016749:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809218176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2118us (2301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135708.016764:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783135708.016882:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809218176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135708.526635:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135708.526665:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809218304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135708.526749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135708.526805:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809218304 00000100:00100000:3.0:1783135708.526813:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809218304 00000100:00100000:3.0:1783135708.528408:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135708.528427:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809218304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135708.528468:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135708.528544:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1869752809218304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135708.528551:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135708.528616:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809218304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135708.529998:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783135709.040046:0:17798:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:0.0:1783135709.103366:0:17061:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135709.103378:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac5424bf000 from 13 10000000:01000000:0.0:1783135709.103385:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135709.103441:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135709.103454:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135709.103465:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135709.103491:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809218432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135709.103583:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135709.103655:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5dea80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135709.104334:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809218432 00000100:00100000:1.0:1783135709.104354:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809218432 00000100:00100000:1.0:1783135709.104437:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783135709.104448:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+16:17061:x1869752809218432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135709.104466:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135709.104485:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20fc00/0xf7de4ef628ee0cd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0ccb expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135709.104510:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20fc00/0xf7de4ef628ee0cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ccb expref: 17 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135709.104521:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20fc00/0xf7de4ef628ee0cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ccb expref: 17 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135709.104530:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20fc00, rc 0) 00000100:00100000:1.0:1783135709.104588:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17061:x1869752809218432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135709.104595:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783135709.106770:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809218432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135709.106798:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135709.106810:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135709.106894:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809218560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135709.106943:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135709.106988:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5dea80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135709.107067:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809218560 00000100:00100000:1.0:1783135709.107073:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809218560 00000100:00100000:1.0:1783135709.107175:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783135709.107185:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17061:x1869752809218560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135709.107333:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17061:x1869752809218560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135709.107342:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783135709.107481:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809218560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135709.107511:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809218688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135709.107552:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135709.107578:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5dea80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135709.107631:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809218688 00000100:00100000:1.0:1783135709.107635:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809218688 00000100:00100000:1.0:1783135709.107663:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783135709.107670:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17061:x1869752809218688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135709.107782:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17061:x1869752809218688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135709.107788:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135709.107952:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809218688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783135709.114184:0:18280:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783135709.116899:0:17061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783135709.116974:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135709.116988:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135709.117003:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135709.117016:0:17061:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135709.117021:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac678352000 from 13 10000000:01000000:2.0:1783135709.117024:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135709.117071:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135709.117080:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135709.117281:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135709.117310:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809218816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135709.117383:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135709.117489:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5424c4300 going to sleep for 11 seconds 00000100:00100000:1.0:1783135709.118126:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809218816 00000100:00100000:1.0:1783135709.118149:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809218816 00000100:00100000:1.0:1783135709.118869:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783135709.118882:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+17:17061:x1869752809218816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135709.118915:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135709.118932:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628ee0ce0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0cd9 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135709.118960:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628ee0ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0cd9 expref: 18 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135709.118971:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628ee0ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0cd9 expref: 18 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135709.118980:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20fe00, rc 0) 00000100:00100000:1.0:1783135709.119055:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17061:x1869752809218816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135709.119062:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783135709.119156:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809218816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135709.119174:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135709.119185:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135709.119274:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809218944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135709.119327:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135709.119361:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5424c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1783135709.119507:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809218944 00000100:00100000:3.0:1783135709.119514:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809218944 00000100:00100000:3.0:1783135709.119551:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783135709.119559:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac64137d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17061:x1869752809218944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135709.119760:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac64137d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17061:x1869752809218944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 202us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135709.119775:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135709.120017:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809218944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135709.120055:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809219072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135709.120172:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135709.120205:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5de3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135709.120333:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809219072 00000100:00100000:1.0:1783135709.120338:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809219072 00000100:00100000:1.0:1783135709.120455:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783135709.120463:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17061:x1869752809219072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135709.120557:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:17061:x1869752809219072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135709.120574:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783135709.120648:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809219072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783135709.121837:0:18281:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783135709.121994:0:17061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783135709.122016:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135709.122025:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135709.122036:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135709.550586:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135710.318732:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783135710.574380:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135711.598643:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135712.622593:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135712.622728:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809219200:0@lo:400:kworker.0 00000100:00100000:2.0:1783135712.622860:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135712.623065:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809219200 00000100:00100000:1.0:1783135712.623076:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809219200 00000100:00100000:1.0:1783135712.623177:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135712.623200:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:3646:x1869752809219200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135712.623286:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:3646:x1869752809219200:12345-0@lo:400:kworker.0 Request processed in 99us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135712.623295:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135712.623376:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809219200:0@lo:400:kworker.0 00000100:00080000:0.0:1783135712.629545:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135712.629557:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135712.629561:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135712.629564:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135712.629593:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1783135712.629616:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135712.629620:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135712.629624:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1783135712.629628:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809219328:0@lo:400:kworker.0 00000100:00080000:0.0:1783135712.629628:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135712.629666:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135712.629679:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809219712:0@lo:400:kworker.0 00000100:00100000:3.0:1783135712.629774:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809219456:0@lo:400:kworker.0 00000100:00100000:2.0:1783135712.636259:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135712.636259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135712.636366:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809219712 00000100:00100000:0.0:1783135712.636379:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809219712 00000100:00100000:2.0:1783135712.636381:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809219328 00000100:00100000:2.0:1783135712.636387:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809219328 00000100:00100000:2.0:1783135712.636473:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783135712.636473:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135712.636492:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809219712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135712.636493:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809219328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135712.636614:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809219328:12345-0@lo:400:kworker.0 Request processed in 129us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135712.636624:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783135712.636676:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809219712:12345-0@lo:400:kworker.0 Request processed in 190us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135712.636685:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135712.636720:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809219584:0@lo:400:kworker.0 00000100:00100000:3.0:1783135712.636767:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135712.636784:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135712.636836:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809219456 00000100:00100000:0.0:1783135712.636841:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809219456 00000100:00100000:0.0:1783135712.636889:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135712.636899:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809219456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135712.636958:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809219456:12345-0@lo:400:kworker.0 Request processed in 61us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135712.637223:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135712.637253:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809219584 00000100:00100000:0.0:1783135712.637257:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809219584 00000100:00100000:0.0:1783135712.637285:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135712.637294:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809219584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135712.637338:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809219584:12345-0@lo:400:kworker.0 Request processed in 46us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135712.637345:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135712.637375:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809219584:0@lo:400:kworker.0 00010000:00080000:0.0:1783135712.637415:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac5438ad500 x1869752809219712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135712.637426:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809219712:0@lo:400:kworker.0 00010000:00080000:3.0:1783135712.640814:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac5438adc00 x1869752809219456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135712.640843:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809219456:0@lo:400:kworker.0 00000100:00100000:2.0:1783135712.642684:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809219328:0@lo:400:kworker.0 00000040:00080000:3.0:1783135713.007216:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783135713.136041:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809219840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135713.136165:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135713.136264:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809219840 00000100:00100000:2.0:1783135713.136281:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809219840 00000100:00100000:2.0:1783135713.136359:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135713.136371:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809219840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135713.136425:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135713.136482:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809219840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135713.136490:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135713.136553:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809219840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135713.649794:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135713.649838:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809219968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135713.650009:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135713.650245:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809219968 00000100:00100000:3.0:1783135713.650254:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809219968 00000100:00100000:3.0:1783135713.650329:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135713.650338:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809219968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135713.650448:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135713.650508:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809219968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135713.650516:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135713.650617:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809219968:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783135713.656585:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135714.670596:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783135715.220167:0:18568:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783135715.220172:0:18568:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783135715.220294:0:18568:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783135715.220412:0:18568:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ac642c1d000 00000020:01000004:2.0:1783135715.220431:0:18568:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783135715.220447:0:18568:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783135715.220464:0:18568:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ac54359cd40) 00000020:00000080:2.0:1783135715.220482:0:18568:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783135715.258695:0:18568:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783135715.260898:0:18568:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783135715.261327:0:18568:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783135715.261701:0:18568:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783135715.261901:0:18568:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783135715.262253:0:18568:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783135715.262453:0:18568:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1783135715.264389:0:18568:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783135715.264617:0:18568:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783135715.264630:0:18568:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135715.264646:0:18568:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7de4ef628ee0cee 00000020:01000004:3.0:1783135715.264655:0:18568:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1783135715.264676:0:18568:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783135715.264680:0:18568:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783135715.264686:0:18568:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783135715.264690:0:18568:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783135715.264703:0:18568:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ac67b4bcd40) 00000020:00000080:3.0:1783135715.264715:0:18568:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1783135715.267859:0:18568:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135715.268034:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783135715.268040:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783135715.273547:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783135715.273564:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783135715.273820:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783135715.273826:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783135715.275362:0:18568:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135715.275568:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783135715.275575:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783135715.277551:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783135715.277564:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783135715.302435:0:18568:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135715.302676:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783135715.302684:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783135715.304845:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135715.304863:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1783135715.306129:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783135715.306149:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783135715.313443:0:18568:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135715.313650:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135715.313657:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783135715.319619:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135715.319634:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783135715.388367:0:18568:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135715.388600:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135715.388612:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783135715.393421:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135715.393436:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783135715.394077:0:18568:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783135715.394163:0:18568:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1783135715.394301:0:18568:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1783135715.422799:0:18568:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783135715.422862:0:18568:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.106@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1783135715.422867:0:18568:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783135715.422869:0:18568:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135715.422871:0:18568:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135715.422872:0:18568:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135715.422873:0:18568:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135715.422879:0:18568:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135715.422881:0:18568:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135715.422883:0:18568:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135715.422884:0:18568:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135715.422888:0:18568:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1783135715.422890:0:18568:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135715.422891:0:18568:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135715.422892:0:18568:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135715.422893:0:18568:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135715.422894:0:18568:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135715.422895:0:18568:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135715.422895:0:18568:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135715.422896:0:18568:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135715.422897:0:18568:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135715.422940:0:18568:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783135715.422963:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220096:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783135715.423326:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135715.423505:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b1c3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135715.427979:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809220096 00000100:00100000:3.0:1783135715.427997:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809220096 00000100:00100000:2.0:1783135715.428272:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783135715.428285:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:18568:x1869752809220096:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783135715.428333:0:17059:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783135715.428336:0:17059:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1783135715.428340:0:17059:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783135715.428865:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:18568:x1869752809220096:12345-0@lo:253:mount.lustre.0 Request processed in 578us (5535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.428874:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135715.431537:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220096:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783135715.431559:0:18568:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783135715.431562:0:18568:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135715.431564:0:18568:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135715.431565:0:18568:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135715.431566:0:18568:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135715.431568:0:18568:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135715.431569:0:18568:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135715.431570:0:18568:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135715.431572:0:18568:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135715.431573:0:18568:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783135715.432380:0:18568:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ac642c1d000 from lustre-OST0000 10000000:01000000:1.0:1783135715.432428:0:18568:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783135715.432431:0:18568:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783135715.432442:0:18568:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ac543598000 local copy 00010000:00010000:1.0:1783135715.432456:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135715.432623:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135715.432700:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135715.432764:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b1c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135715.433393:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809220224 00000100:00100000:2.0:1783135715.433403:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809220224 00000100:00100000:2.0:1783135715.433464:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783135715.433473:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:18568:x1869752809220224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135715.433579:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:18568:x1869752809220224:12345-0@lo:501:mount.lustre.0 Request processed in 107us (879us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135715.433587:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135715.436926:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220224:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783135715.436959:0:18568:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783135715.437014:0:18568:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783135715.437035:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.437046:0:18568:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135715.437152:0:18568:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ac642c1d000 10000000:01000000:3.0:1783135715.437158:0:18568:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783135715.437164:0:18568:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783135715.437167:0:18568:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135715.438468:0:18568:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783135715.438479:0:18568:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783135715.438532:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67f908600/0xf7de4ef628ee0cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135715.438545:0:18568:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67f908600/0xf7de4ef628ee0cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135715.438558:0:18568:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67f908600/0xf7de4ef628ee0cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135715.438589:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135715.438679:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.438728:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6580a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135715.438795:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809220352 00000100:00100000:1.0:1783135715.438803:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809220352 00000100:00100000:1.0:1783135715.439341:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783135715.439354:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+18:18568:x1869752809220352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135715.439371:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135715.439387:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628ee0d03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0cfc expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135715.439412:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628ee0d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0cfc expref: 19 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135715.439423:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20e200/0xf7de4ef628ee0d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0cfc expref: 19 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135715.439433:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e200, rc 0) 00000100:00100000:1.0:1783135715.439481:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:18568:x1869752809220352:12345-0@lo:101:mount.lustre.0 Request processed in 130us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135715.439488:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135715.439665:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135715.439683:0:18568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67f908600/0xf7de4ef628ee0cfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d03 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.439692:0:18568:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67f908600/0xf7de4ef628ee0cfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0d03 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135715.440987:0:18568:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783135715.443663:0:18568:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135715.447368:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783135715.447438:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783135715.447451:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783135715.447461:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783135715.447474:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783135715.447488:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783135715.447514:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783135715.447520:0:18568:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783135715.447628:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135715.447703:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135715.448870:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672e65600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135715.452333:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809220480 00000100:00100000:1.0:1783135715.452347:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809220480 00000100:00100000:1.0:1783135715.452413:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783135715.452426:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:18568:x1869752809220480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135715.452630:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:18568:x1869752809220480:12345-0@lo:501:mount.lustre.0 Request processed in 207us (4926us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135715.452651:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783135715.452865:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135715.452916:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135715.452961:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135715.453008:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672e65600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135715.453068:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809220608 00000100:00100000:0.0:1783135715.453073:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809220608 00000100:00100000:0.0:1783135715.453144:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783135715.453153:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:18568:x1869752809220608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135715.453964:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:18568:x1869752809220608:12345-0@lo:503:mount.lustre.0 Request processed in 809us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135715.453973:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783135715.454354:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220608:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783135715.454822:0:18568:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135715.454922:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135715.454976:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.456148:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809220736 00000100:00100000:2.0:1783135715.456159:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809220736 00000100:00100000:2.0:1783135715.456229:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783135715.456238:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:18568:x1869752809220736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135715.456808:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:18568:x1869752809220736:12345-0@lo:502:mount.lustre.0 Request processed in 568us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.456818:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783135715.457005:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5430723c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135715.457290:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135715.457555:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783135715.457590:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783135715.457605:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783135715.457626:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783135715.457640:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783135715.457655:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783135715.457670:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783135715.457684:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783135715.457698:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1783135715.457713:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1783135715.457726:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1783135715.457738:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1783135715.457772:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135715.457826:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135715.457872:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5430723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135715.457968:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809220864 00000100:00100000:0.0:1783135715.457974:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809220864 00000100:00100000:0.0:1783135715.458007:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783135715.458016:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:18568:x1869752809220864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135715.458180:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:18568:x1869752809220864:12345-0@lo:502:mount.lustre.0 Request processed in 153us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135715.458188:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783135715.461492:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135715.461622:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1783135715.461640:0:18568:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1783135715.465482:0:18585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783135715.465496:0:18585:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1783135715.465504:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135715.465507:0:18585:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783135715.465517:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135715.465535:0:18585:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ac66b5899c0) 00000020:00000080:2.0:1783135715.465565:0:18585:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783135715.465572:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783135715.465663:0:18585:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac642c1d000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783135715.465672:0:18585:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783135715.465680:0:18585:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf7de4ef628ee0d11 00010000:00010000:2.0:1783135715.473526:0:18585:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1783135715.474337:0:18585:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:2.0:1783135715.479742:0:18585:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1783135715.497483:0:18585:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783135715.497497:0:18585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135715.497502:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135715.497504:0:18585:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783135715.497507:0:18585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783135715.497510:0:18585:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1783135715.497512:0:18585:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135715.497518:0:18585:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135715.497520:0:18585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783135715.497522:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135715.497524:0:18585:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783135715.497526:0:18585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135715.497529:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135715.497530:0:18585:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135715.497532:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135715.497534:0:18585:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783135715.497536:0:18585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135715.497538:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135715.497539:0:18585:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783135715.497541:0:18585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135715.497543:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135715.497544:0:18585:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783135715.497546:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783135715.497577:0:18585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135715.497579:0:18585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135715.497580:0:18585:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783135715.497583:0:18585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1783135715.499878:0:18568:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1783135715.499936:0:18568:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783135715.499965:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67f908600/0xf7de4ef628ee0cfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d03 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.499987:0:18568:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67f908600/0xf7de4ef628ee0cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d03 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135715.499996:0:18568:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac642c1d000 from 1 10000000:01000000:3.0:1783135715.499999:0:18568:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135715.500041:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.500049:0:18568:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.500058:0:18568:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135715.500084:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135715.500205:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135715.500247:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5430723c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135715.500612:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809220992 00000100:00100000:0.0:1783135715.500621:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809220992 00000100:00100000:0.0:1783135715.500691:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135715.500701:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:18568:x1869752809220992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135715.500717:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135715.500730:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e64a000/0xf7de4ef628ee0d1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0d18 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.500756:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e64a000/0xf7de4ef628ee0d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d18 expref: 20 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.500768:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e64a000/0xf7de4ef628ee0d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d18 expref: 20 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.500777:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64a000, rc 0) 00000100:00100000:0.0:1783135715.500818:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:18568:x1869752809220992:12345-0@lo:101:mount.lustre.0 Request processed in 119us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135715.500837:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783135715.502627:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809220992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135715.502667:0:18568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.502681:0:18568:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135715.505966:0:18568:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783135715.508188:0:18568:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135715.508433:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1783135715.508462:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1783135715.508492:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1783135715.508497:0:18568:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1783135715.508590:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135715.508668:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135715.508717:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135715.509416:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809221120 00000100:00100000:2.0:1783135715.509428:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809221120 00000100:00100000:2.0:1783135715.509488:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783135715.509497:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:18568:x1869752809221120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135715.509642:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:18568:x1869752809221120:12345-0@lo:501:mount.lustre.0 Request processed in 145us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.509650:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783135715.512378:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135715.512455:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135715.512542:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135715.512591:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543072240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135715.519726:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809221248 00000100:00100000:2.0:1783135715.519746:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809221248 00000100:00100000:2.0:1783135715.519804:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783135715.519815:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:18568:x1869752809221248:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135715.520369:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:18568:x1869752809221248:12345-0@lo:503:mount.lustre.0 Request processed in 540us (7812us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.520387:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783135715.520572:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221248:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783135715.525984:0:18568:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135715.527220:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135715.527310:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135715.527403:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135715.528221:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809221376 00000100:00100000:0.0:1783135715.528232:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809221376 00000100:00100000:1.0:1783135715.528357:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783135715.528368:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:18568:x1869752809221376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135715.528540:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:18568:x1869752809221376:12345-0@lo:502:mount.lustre.0 Request processed in 171us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135715.528548:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783135715.528964:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135715.529366:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783135715.529402:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783135715.529417:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783135715.529428:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783135715.529452:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1783135715.529466:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1783135715.529478:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1783135715.529491:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1783135715.529503:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783135715.529514:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1783135715.529526:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1783135715.529562:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135715.529617:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135715.529662:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c7240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135715.530614:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809221504 00000100:00100000:2.0:1783135715.530623:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809221504 00000100:00100000:2.0:1783135715.530677:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783135715.530686:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:18568:x1869752809221504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135715.530819:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:18568:x1869752809221504:12345-0@lo:502:mount.lustre.0 Request processed in 133us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.530958:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135715.531338:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135715.531421:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1783135715.531434:0:18568:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1783135715.533368:0:18589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135715.533383:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135715.533385:0:18589:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783135715.533395:0:18589:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac642c1d000 00000020:00000080:0.0:1783135715.533398:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135715.533406:0:18589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135715.533408:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135715.533409:0:18589:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783135715.533411:0:18589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135715.533414:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135715.533415:0:18589:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783135715.533418:0:18589:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac642c1d000 00000020:00000080:0.0:1783135715.533420:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135715.533523:0:18589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135715.533528:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135715.533529:0:18589:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783135715.533532:0:18589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135715.533534:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135715.533536:0:18589:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783135715.533548:0:18589:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac642c1d000 00000020:00000080:0.0:1783135715.533550:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135715.543429:0:18589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135715.555214:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135715.555223:0:18589:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135715.555235:0:18589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135715.555244:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135715.555245:0:18589:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783135715.555251:0:18589:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac642c1d000 00000020:00000080:3.0:1783135715.555254:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135715.555363:0:18589:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135715.555367:0:18589:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135715.555368:0:18589:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783135715.555372:0:18589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1783135715.556268:0:18568:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783135715.556309:0:18568:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135715.556336:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135715.556349:0:18568:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135715.556411:0:18568:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783135715.556414:0:18568:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ac642c1d000 10000000:01000000:2.0:1783135715.556418:0:18568:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ac642c1d000 10000000:01000000:2.0:1783135715.556421:0:18568:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135715.556428:0:18568:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac642c1d000 from 1 10000000:01000000:2.0:1783135715.556431:0:18568:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135715.556475:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67f908a00/0xf7de4ef628ee0d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135715.556485:0:18568:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67f908a00/0xf7de4ef628ee0d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135715.556499:0:18568:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67f908a00/0xf7de4ef628ee0d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135715.556542:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135715.556620:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.556662:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac673802480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135715.556687:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809221632 00000100:00100000:2.0:1783135715.556693:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809221632 00000100:00100000:2.0:1783135715.556742:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783135715.556751:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:18568:x1869752809221632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135715.556764:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135715.556777:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0d2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0d26 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135715.556799:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d26 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135715.556811:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67f909000/0xf7de4ef628ee0d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d26 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135715.556820:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67f909000, rc 0) 00000100:00100000:2.0:1783135715.556861:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809221632:12345-0@lo:101:mount.lustre.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.556868:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783135715.556920:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135715.556936:0:18568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67f908a00/0xf7de4ef628ee0d26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d2d expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135715.556945:0:18568:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67f908a00/0xf7de4ef628ee0d26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0d2d expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135715.567526:0:18568:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1783135715.567815:0:18568:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135715.568013:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783135715.568197:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783135715.568212:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783135715.568225:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783135715.568239:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783135715.568251:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783135715.568263:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783135715.568276:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783135715.568289:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783135715.568301:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783135715.568313:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783135715.568324:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783135715.568335:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783135715.568360:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783135715.568376:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783135715.568387:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783135715.568400:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783135715.568412:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783135715.568423:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783135715.568436:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783135715.568448:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783135715.568461:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783135715.568474:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783135715.568486:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783135715.568499:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1783135715.568511:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1783135715.568523:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1783135715.568534:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1783135715.568548:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1783135715.568580:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1783135715.568596:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1783135715.568608:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1783135715.568621:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1783135715.568633:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1783135715.568645:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1783135715.568658:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1783135715.568670:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1783135715.568689:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1783135715.568694:0:18568:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1783135715.568795:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135715.568871:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.568916:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac673802540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135715.568954:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809221760 00000100:00100000:2.0:1783135715.568961:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809221760 00000100:00100000:2.0:1783135715.569008:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135715.569016:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809221760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135715.569696:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809221760:12345-0@lo:501:mount.lustre.0 Request processed in 677us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.569705:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783135715.569765:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135715.569804:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135715.569855:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.569878:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac673802540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135715.569892:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809221888 00000100:00100000:2.0:1783135715.569897:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809221888 00000100:00100000:2.0:1783135715.569920:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783135715.569926:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809221888:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135715.570005:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809221888:12345-0@lo:503:mount.lustre.0 Request processed in 79us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.570012:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783135715.570064:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809221888:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135715.570505:0:18568:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135715.570577:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809222016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135715.570617:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.570643:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675354240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135715.570661:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809222016 00000100:00100000:2.0:1783135715.570665:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809222016 00000100:00100000:2.0:1783135715.570689:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783135715.570696:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809222016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135715.570781:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809222016:12345-0@lo:502:mount.lustre.0 Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.570787:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783135715.570830:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809222016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135715.570999:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783135715.571025:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1783135715.571037:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1783135715.571049:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1783135715.571061:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1783135715.571122:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1783135715.574262:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1783135715.574308:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1783135715.574325:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783135715.574338:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1783135715.574350:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1783135715.574374:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1783135715.574385:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1783135715.574397:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1783135715.574411:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1783135715.574423:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1783135715.574435:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1783135715.574448:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1783135715.574461:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1783135715.574476:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1783135715.574491:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1783135715.574527:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1783135715.574543:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1783135715.574558:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1783135715.574571:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1783135715.574585:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1783135715.574599:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1783135715.574611:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1783135715.574623:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1783135715.574635:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1783135715.574648:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1783135715.574662:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1783135715.574673:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1783135715.574684:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1783135715.574695:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1783135715.574706:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1783135715.574716:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1783135715.574740:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1783135715.574754:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1783135715.574766:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1783135715.574778:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1783135715.574790:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1783135715.574802:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1783135715.574814:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1783135715.575704:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1783135715.575726:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1783135715.575738:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1783135715.575750:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1783135715.575816:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809222144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135715.575961:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.576012:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809222144 00000100:00100000:2.0:1783135715.576116:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809222144 00000100:00100000:2.0:1783135715.576178:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783135715.576187:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809222144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135715.576306:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809222144:12345-0@lo:502:mount.lustre.0 Request processed in 120us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.576314:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783135715.576372:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac673802480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135715.576399:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809222144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135715.577440:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1783135715.577480:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1783135715.577516:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809222272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135715.577569:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.577644:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6586f3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135715.577688:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809222272 00000100:00100000:3.0:1783135715.577696:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809222272 00000100:00100000:3.0:1783135715.577771:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783135715.577781:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809222272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135715.577967:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809222272:12345-0@lo:502:mount.lustre.0 Request processed in 186us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135715.577974:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783135715.578312:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809222272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135715.578367:0:18568:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1783135715.578378:0:18568:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1783135715.579323:0:18594:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783135715.579340:0:18594:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ac67c168000) 00000020:00000080:1.0:1783135715.579366:0:18594:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1783135715.579599:0:18594:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac642c1d000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783135715.579604:0:18594:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac642c1d000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783135715.579606:0:18594:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac642c1d000 3 00010000:00080000:1.0:1783135715.579636:0:18594:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac5431db800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1783135715.587987:0:18594:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1783135715.588238:0:18594:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783135715.588287:0:18594:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783135715.588304:0:18594:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf7de4ef628ee0d3b 00000100:00080000:1.0:1783135715.588316:0:18594:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135715.588324:0:18594:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ac5431db800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135715.588363:0:18594:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5441bc380 x1869752809222400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135715.588408:0:18594:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783135715.588772:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135715.588777:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135715.588780:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135715.588790:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135715.588816:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135715.588819:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135715.588822:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135715.588825:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135715.588878:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809222912:0@lo:400:kworker.0 00000100:00100000:2.0:1783135715.588958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.588994:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135715.589000:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809222528:0@lo:400:kworker.0 00000100:00100000:0.0:1783135715.589161:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869752809222400:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783135715.589196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.589219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.589252:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809222656:0@lo:400:kworker.0 00000100:00100000:2.0:1783135715.589277:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.589295:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135715.589303:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809222912 00000100:00100000:0.0:1783135715.589310:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809222912 00000100:00100000:0.0:1783135715.589348:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809222400 00000100:00100000:0.0:1783135715.589352:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809222400 00000100:00100000:0.0:1783135715.589359:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809222656 00000100:00100000:0.0:1783135715.589362:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809222656 00000100:00100000:0.0:1783135715.589375:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135715.589383:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809222912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135715.589457:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809222912:12345-0@lo:400:kworker.0 Request processed in 74us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135715.589465:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135715.589481:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135715.589487:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809222656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135715.589514:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809222656:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135715.589519:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135715.589529:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135715.589533:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809222400:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783135715.589553:0:17066:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 619 last 0 00000020:00000080:0.0:1783135715.589583:0:17066:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf7de4ef628ee0d42 00000004:00100000:0.0:1783135715.589600:0:17066:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783135715.589630:0:17066:0:(import.c:65:import_set_state_nolock()) ffff8ac67f83f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135715.589638:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809222784:0@lo:400:kworker.0 00000100:00100000:2.0:1783135715.589664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135715.589672:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1869752809222400:12345-0@lo:38:llog_process_th.0 Request processed in 137us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135715.589678:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783135715.589694:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac543b3dc00 x1869752809222656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783135715.589703:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac5441bc380 x1869752809222400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135715.589707:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809222656:0@lo:400:kworker.0 00000100:00100000:0.0:1783135715.589711:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135715.589717:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1783135715.589723:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783135715.589728:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783135715.589731:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac5431db800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135715.589736:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1869752809222400:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783135715.589754:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809222528 00000100:00100000:2.0:1783135715.589757:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809222528 00000100:00100000:2.0:1783135715.589783:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809222784 00000100:00100000:2.0:1783135715.589786:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809222784 00000100:00100000:2.0:1783135715.589799:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135715.589804:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809222528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135715.589899:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809222528:12345-0@lo:400:kworker.0 Request processed in 94us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.589907:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135715.589922:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135715.589928:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809222784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135715.589972:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809222784:12345-0@lo:400:kworker.0 Request processed in 43us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135715.589977:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135715.590001:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809222528:0@lo:400:kworker.0 00010000:00080000:2.0:1783135715.590012:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac543b3c380 x1869752809222912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135715.590118:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809222912:0@lo:400:kworker.0 00000100:00100000:2.0:1783135715.590162:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809222784:0@lo:400:kworker.0 00000020:01000004:1.0:1783135715.594621:0:18594:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783135715.594644:0:18594:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ac67c16cd40) 00000020:00000080:1.0:1783135715.594673:0:18594:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1783135715.598164:0:18594:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac642c1d000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783135715.598176:0:18594:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac642c1d000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783135715.598179:0:18594:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac642c1d000 3 00010000:00080000:1.0:1783135715.598234:0:18594:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac5431da000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1783135715.601460:0:18594:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1783135715.601588:0:18594:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1783135715.601641:0:18594:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783135715.601659:0:18594:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf7de4ef628ee0d50 00000100:00080000:1.0:1783135715.601672:0:18594:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135715.601681:0:18594:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ac5431da000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135715.601738:0:18594:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5441bc000 x1869752809223040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135715.601785:0:18594:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783135715.602119:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135715.602125:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135715.602128:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135715.602131:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135715.602146:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135715.602149:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135715.602152:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135715.602154:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1783135715.603288:0:18594:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1783135715.603469:0:18568:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1783135715.603505:0:18568:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135715.603531:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67f908a00/0xf7de4ef628ee0d26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d2d expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135715.603542:0:18568:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67f908a00/0xf7de4ef628ee0d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d2d expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783135715.603601:0:18568:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783135715.603604:0:18568:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135715.603605:0:18568:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135715.603606:0:18568:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135715.603607:0:18568:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135715.603609:0:18568:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135715.603610:0:18568:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135715.603612:0:18568:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135715.603614:0:18568:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135715.603618:0:18568:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783135715.603621:0:18568:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135715.603622:0:18568:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135715.603623:0:18568:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135715.603624:0:18568:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135715.603625:0:18568:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135715.603626:0:18568:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135715.603627:0:18568:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135715.603629:0:18568:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135715.603630:0:18568:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135715.603654:0:18568:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783135715.603675:0:18568:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809223168:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135715.603762:0:18568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.603799:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809223168 00000100:00100000:2.0:1783135715.603806:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809223168 00000100:00100000:2.0:1783135715.604182:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783135715.604194:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809223168:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783135715.604234:0:17058:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783135715.604251:0:17058:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783135715.604293:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869752809223040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783135715.604336:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135715.604384:0:18568:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac673802840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135715.604508:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809223040 00000100:00100000:1.0:1783135715.604513:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809223040 00000100:00100000:1.0:1783135715.604540:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135715.604546:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809223040:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783135715.604571:0:17066:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 619 last 0 00000020:00000080:1.0:1783135715.604606:0:17066:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf7de4ef628ee0d57 00000004:00100000:1.0:1783135715.604621:0:17066:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783135715.604655:0:17066:0:(import.c:65:import_set_state_nolock()) ffff8ac5431d8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135715.604714:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1869752809223040:12345-0@lo:38:llog_process_th.0 Request processed in 167us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135715.604721:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783135715.604768:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ac5441bc000 x1869752809223040/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135715.604779:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135715.604787:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1783135715.604795:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783135715.604800:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783135715.604803:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac5431da000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783135715.604809:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1869752809223040:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1783135715.620022:0:17058:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783135715.620058:0:17058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783135715.622317:0:17080:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783135715.622331:0:17080:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783135715.622365:0:17080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.622386:0:17080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67e20ec00/0xf7de4ef628ee0ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ca1 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.622395:0:17080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0caf expref: 21 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.622404:0:17080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.622447:0:17080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0cb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0caf expref: 21 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.622476:0:17080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0cb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0caf expref: 21 pid: 17056 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135715.622492:0:17080:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809223296:0@lo:104: 00000100:00100000:0.0:1783135715.622562:0:17080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135715.622623:0:17080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67e20ec00/0xf7de4ef628ee0ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0ca1 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.622631:0:17080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67e20ec00/0xf7de4ef628ee0ca8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0ca1 expref: 21 pid: 17058 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135715.622639:0:17080:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809223424:0@lo:104: 00000100:00100000:0.0:1783135715.622663:0:17080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135715.622685:0:17080:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6493c73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135715.622915:0:17048:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783135715.622943:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809223296 00000100:00100000:3.0:1783135715.622952:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809223296 00000100:00100000:3.0:1783135715.622985:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809223424 00000100:00100000:3.0:1783135715.622987:0:17048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809223424 00000100:00100000:3.0:1783135715.623002:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135715.623010:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:17080:x1869752809223296:12345-0@lo:104: 00010000:00010000:3.0:1783135715.623273:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.623336:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783135715.623343:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:17080:x1869752809223296:12345-0@lo:104: Request processed in 333us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135715.623351:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135715.623371:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135715.623377:0:17048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac648bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:17080:x1869752809223424:12345-0@lo:104: 00010000:00010000:3.0:1783135715.623385:0:17048:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.623418:0:17048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783135715.623423:0:17048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac648bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:17080:x1869752809223424:12345-0@lo:104: Request processed in 47us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135715.623429:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783135715.623469:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135715.623476:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.623484:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908e00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:3.0:1783135715.623488:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.623508:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135715.623515:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135715.623521:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135715.623522:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135715.623528:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135715.623536:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac650989e00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135715.623539:0:18220:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135715.623545:0:18220:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.623552:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135715.623552:0:18220:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135715.623558:0:18220:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135715.623559:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135715.623572:0:18220:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.623583:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.623590:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67f908e00/0xf7de4ef628ee0caf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0cb6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.623601:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135715.623603:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135715.623605:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135715.623619:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135715.623631:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809223552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135715.623661:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135715.623665:0:18220:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135715.623682:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135715.623689:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac650989e00/0xf7de4ef628ee0ca1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0ca8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135715.623691:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809223552 00000100:00100000:3.0:1783135715.623694:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809223552 00010000:00010000:1.0:1783135715.623704:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135715.623705:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135715.623707:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135715.623710:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0cb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0caf expref: 22 pid: 17056 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135715.623719:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809223680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135715.623730:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135715.623742:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:3648:x1869752809223552:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135715.623748:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135715.623751:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135715.623756:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0cb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0caf expref: 22 pid: 17056 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.623766:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0cb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0caf expref: 22 pid: 17056 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.623782:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135715.623798:0:17049:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783135715.623805:0:17049:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1783135715.623807:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:3648:x1869752809223552:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135715.623814:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135715.623824:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809223680 00010000:00010000:0.0:1783135715.624305:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0cb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0caf expref: 21 pid: 17056 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135715.624317:0:17080:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809223296:0@lo:104: 00000100:00100000:0.0:1783135715.624326:0:17080:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809223424:0@lo:104: 00010000:00010000:0.0:1783135715.624347:0:17080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135715.625231:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809223680 00010000:00010000:3.0:1783135715.625265:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67e20ec00/0xf7de4ef628ee0ca8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0ca1 expref: 21 pid: 17058 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135715.625304:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135715.625312:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:3646:x1869752809223680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135715.625324:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783135715.625525:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:18568:x1869752809223168:12345-0@lo:253:mount.lustre.0 Request processed in 21333us (21761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135715.625535:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1783135715.625539:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67e20ec00/0xf7de4ef628ee0ca8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0ca1 expref: 21 pid: 17058 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.625550:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67e20ec00/0xf7de4ef628ee0ca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0ca1 expref: 20 pid: 17058 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.625566:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20ec00/0xf7de4ef628ee0ca8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0ca1 expref: 20 pid: 17058 timeout: 719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135715.625639:0:18568:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:18568:1869752809223168:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135715.625654:0:18568:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783135715.625658:0:18568:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135715.625659:0:18568:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135715.625661:0:18568:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135715.625663:0:18568:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135715.625664:0:18568:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135715.625666:0:18568:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135715.625668:0:18568:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135715.625670:0:18568:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135715.625671:0:18568:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783135715.625685:0:18568:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1783135715.625740:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.625758:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783135715.625774:0:17050:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005476921s 00010000:00010000:3.0:1783135715.625778:0:17050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.625784:0:17050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.625790:0:17050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.625797:0:17050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.625803:0:17050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64bc00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135715.625807:0:17050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.625816:0:17050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.626980:0:17050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135715.627006:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135715.627104:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:3646:x1869752809223680:12345-0@lo:103:ldlm_bl.0 Request processed in 1772us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135715.627114:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135715.627287:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809223552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135715.627524:0:17080:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.627546:0:17080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135715.627554:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e64bc00/0xf7de4ef628ee0d5e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135715.627775:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809223680:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1783135715.639584:0:18568:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1783135715.641982:0:18568:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783135715.641992:0:18568:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783135715.642038:0:18568:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783135715.642297:0:18568:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783135715.642318:0:18568:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783135715.642345:0:18568:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1783135715.643190:0:18568:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135715.643397:0:18568:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783135715.696879:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783135716.651954:0:18649:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135716.652236:0:18649:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135716.719564:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783135717.166284:0:17061:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783135717.166293:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac5424bf000 from 9 10000000:01000000:3.0:1783135717.166298:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783135717.166350:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135717.166363:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135717.166375:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135717.166403:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809223808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135717.166474:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135717.166528:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439879c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135717.166603:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809223808 00000100:00100000:1.0:1783135717.166611:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809223808 00000100:00100000:1.0:1783135717.166667:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783135717.166677:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+19:17061:x1869752809223808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135717.166691:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135717.166706:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20e000/0xf7de4ef628ee0d6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0d65 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.166730:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20e000/0xf7de4ef628ee0d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d65 expref: 20 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.166758:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20e000/0xf7de4ef628ee0d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d65 expref: 20 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.166767:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e000, rc 0) 00000100:00100000:1.0:1783135717.166823:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:17061:x1869752809223808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135717.166830:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783135717.166875:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809223808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135717.166889:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.166898:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135717.166944:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809223936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783135717.166971:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135717.166987:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317db40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135717.166999:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809223936 00000100:00100000:1.0:1783135717.167002:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809223936 00000100:00100000:1.0:1783135717.167023:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783135717.167029:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:17061:x1869752809223936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783135717.167043:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135717.167059:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135717.167062:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1783135717.167177:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:17061:x1869752809223936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135717.167192:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783135717.167224:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809223936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783135717.167279:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135717.167286:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.167293:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135717.167301:0:17061:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783135717.167303:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac678352000 from 9 10000000:01000000:1.0:1783135717.167305:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783135717.167321:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.167328:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.167335:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135717.167347:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809224064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135717.167370:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135717.167383:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317db40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135717.167394:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809224064 00000100:00100000:1.0:1783135717.167397:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809224064 00000100:00100000:1.0:1783135717.167417:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783135717.167423:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:17061:x1869752809224064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135717.167435:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135717.167443:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628ee0d7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0d73 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.167456:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628ee0d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d73 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.167464:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628ee0d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d73 expref: 21 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.167470:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f200, rc 0) 00000100:00100000:1.0:1783135717.167498:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:17061:x1869752809224064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135717.167505:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783135717.167535:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809224064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135717.167544:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.167551:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135717.167583:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809224192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783135717.167610:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135717.167623:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317db40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135717.167635:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809224192 00000100:00100000:1.0:1783135717.167638:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809224192 00000100:00100000:1.0:1783135717.167658:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783135717.167664:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:17061:x1869752809224192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783135717.167680:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135717.167690:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135717.167692:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1783135717.167748:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:17061:x1869752809224192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 83us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135717.167755:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783135717.167783:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809224192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783135717.167819:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135717.167825:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.167832:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135717.744740:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135718.254474:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809224320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135718.254597:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135718.254742:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809224320 00000100:00100000:2.0:1783135718.254753:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809224320 00000100:00100000:2.0:1783135718.254831:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783135718.254844:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809224320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135718.254898:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135718.254961:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809224320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135718.254970:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783135718.255029:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809224320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135718.768260:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135718.768292:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809224448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135718.768397:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135718.768468:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809224448 00000100:00100000:1.0:1783135718.768476:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809224448 00000100:00100000:1.0:1783135718.768545:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135718.768556:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809224448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135718.768790:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783135718.768862:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809224448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 307us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135718.768885:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135718.768950:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809224448:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135718.770420:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135719.801273:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135720.559323:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1783135720.814969:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135720.814977:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135720.814980:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135720.814991:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135720.815019:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135720.815023:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135720.815025:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135720.815028:0:468:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783135720.815110:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3649:1869752809224576:0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.815196:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135720.815253:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809225088:0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.815283:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135720.815314:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135720.815320:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809224960:0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.815352:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135720.816272:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135720.817952:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809224704:0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818011:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135720.818056:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809225216:0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818105:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135720.818133:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783135720.818140:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809224832:0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135720.818186:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809225344:0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818209:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135720.818243:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809224576 00000100:00100000:3.0:1783135720.818250:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809224576 00000100:00100000:3.0:1783135720.818305:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783135720.818314:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:3649:x1869752809224576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818366:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:3649:x1869752809224576:12345-0@lo:400:kworker.0 Request processed in 53us (3171us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135720.818374:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783135720.818414:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809225088 00000100:00100000:3.0:1783135720.818418:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809225088 00000100:00100000:3.0:1783135720.818436:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809225216 00000100:00100000:3.0:1783135720.818439:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809225216 00000100:00100000:3.0:1783135720.818461:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809224832 00000100:00100000:3.0:1783135720.818464:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809224832 00000100:00100000:3.0:1783135720.818476:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809225344 00000100:00100000:3.0:1783135720.818478:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809225344 00000100:00100000:3.0:1783135720.818492:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135720.818498:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809225088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818532:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809225088:12345-0@lo:400:kworker.0 Request processed in 34us (3248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135720.818538:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135720.818551:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135720.818557:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809225216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818588:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809225216:12345-0@lo:400:kworker.0 Request processed in 31us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135720.818594:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135720.818606:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135720.818611:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809224832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818639:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809224832:12345-0@lo:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135720.818653:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135720.818666:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135720.818671:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809225344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818701:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809225344:12345-0@lo:400:kworker.0 Request processed in 30us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135720.818706:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135720.818728:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809224960 00000100:00100000:3.0:1783135720.818732:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809224960 00000100:00100000:3.0:1783135720.818752:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809224704 00000100:00100000:3.0:1783135720.818754:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809224704 00000100:00100000:3.0:1783135720.818766:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135720.818770:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809224960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818816:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809224960:12345-0@lo:400:kworker.0 Request processed in 45us (3463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135720.818822:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135720.818835:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783135720.818841:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809224704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.818869:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809224704:12345-0@lo:400:kworker.0 Request processed in 29us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135720.818875:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1783135720.818967:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67f84f800 x1869752809224832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135720.818982:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809224832:0@lo:400:kworker.0 00010000:00080000:3.0:1783135720.818995:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67f84fb80 x1869752809225344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135720.819016:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809225344:0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.819029:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809224704:0@lo:400:kworker.0 00010000:00080000:3.0:1783135720.819050:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67f84c000 x1869752809225216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135720.819059:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809225216:0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.819118:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809224960:0@lo:400:kworker.0 00000100:00100000:3.0:1783135720.819128:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3649:1869752809224576:0@lo:400:kworker.0 00010000:00080000:3.0:1783135720.819138:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67f84d880 x1869752809225088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135720.819146:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809225088:0@lo:400:kworker.0 00000100:00080000:1.0:1783135720.820975:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135720.820984:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783135721.838917:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135722.628864:0:18939:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783135722.799186:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135707/real 1783135707] req@ffff8ac5438af100 x1869752809217280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135722 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135722.799223:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac5438af100 x1869752809217280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135722 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135722.799233:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135707/real 1783135707] req@ffff8ac5438adf80 x1869752809217408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135722 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135722.799245:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac5438adf80 x1869752809217408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135722 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135722.799266:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67f83f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135722.799878:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783135722.799884:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809217280:0@lo:8:kworker.0 00000100:00080000:1.0:1783135722.799894:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1783135722.802419:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809225472:0@lo:400:kworker.0 00000100:00100000:2.0:1783135722.802514:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783135722.802697:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783135722.802715:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809217408:0@lo:8:kworker.0 00000100:00100000:2.0:1783135722.810978:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135722.811025:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809225600:0@lo:400:kworker.0 00000100:00100000:2.0:1783135722.811157:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783135722.811803:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135722.811809:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135722.811812:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135722.811815:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783135722.811835:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809225600 00000100:00100000:3.0:1783135722.811844:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809225600 00000100:00100000:3.0:1783135722.811920:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135722.811930:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809225600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.812192:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809225600:12345-0@lo:400:kworker.0 Request processed in 264us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135722.812214:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135722.812241:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809225472 00000100:00100000:3.0:1783135722.812244:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809225472 00000100:00100000:3.0:1783135722.812269:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783135722.812276:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:3648:x1869752809225472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.812305:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:3648:x1869752809225472:12345-0@lo:400:kworker.0 Request processed in 31us (9792us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135722.812310:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783135722.812370:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809225728:0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.812397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135722.812428:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809225728 00000100:00100000:3.0:1783135722.812431:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809225728 00000100:00100000:3.0:1783135722.812451:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135722.812457:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809225728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.812485:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809225728:12345-0@lo:400:kworker.0 Request processed in 28us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135722.812491:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1783135722.812524:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67f84e300 x1869752809225728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135722.812538:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809225728:0@lo:400:kworker.0 00000100:00080000:3.0:1783135722.812564:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135722.812568:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783135722.812572:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac67f83f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135722.812578:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 611 00000100:00080000:3.0:1783135722.812582:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783135722.812593:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ac67f83f000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135722.812602:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809225856:0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.812627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135722.812666:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67f84fb80 x1869752809225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135722.812699:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135722.812702:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783135722.812704:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135722.812707:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 611 00000100:00080000:3.0:1783135722.812710:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783135722.812714:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ac64b2cb800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135722.812723:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67f84f800 x1869752809226112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135722.812744:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135722.812751:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809226240:0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.812773:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135722.812803:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809226368:0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.812820:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135722.814427:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809226496:0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.814505:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135722.814556:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809226240 00000100:00100000:3.0:1783135722.814561:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809226240 00000100:00100000:3.0:1783135722.814593:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809226368 00000100:00100000:3.0:1783135722.814595:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809226368 00000100:00100000:3.0:1783135722.814619:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809226496 00000100:00100000:3.0:1783135722.814621:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809226496 00000100:00100000:3.0:1783135722.814644:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135722.814650:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809226240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.814727:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1869752809226240:12345-0@lo:400:kworker.0 Request processed in 76us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135722.814734:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135722.814748:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135722.814764:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809226368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.814802:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809226368:12345-0@lo:400:kworker.0 Request processed in 48us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135722.814809:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135722.814819:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783135722.815197:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809225856 00000100:00100000:0.0:1783135722.815202:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809225856 00000100:00100000:0.0:1783135722.815258:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783135722.815267:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809225856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135722.815344:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809225856:12345-0@lo:400:kworker.0 Request processed in 79us (2716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135722.815350:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783135722.815439:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809225856:0@lo:400:kworker.0 00000100:00100000:0.0:1783135722.815504:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809225600:0@lo:400:kworker.0 00000100:00100000:0.0:1783135722.815517:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809225472:0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.815585:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809226496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.815637:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809226496:12345-0@lo:400:kworker.0 Request processed in 811us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135722.815644:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1783135722.815681:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac544177800 x1869752809226368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135722.815694:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809226368:0@lo:400:kworker.0 00010000:00080000:3.0:1783135722.815705:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac544176d80 x1869752809226240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135722.815713:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1869752809226240:0@lo:400:kworker.0 00000100:00080000:3.0:1783135722.815742:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135722.815747:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135722.815750:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135722.815761:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1783135722.816238:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac544177480 x1869752809226496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135722.816264:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809226496:0@lo:400:kworker.0 00000100:00100000:3.0:1783135722.817045:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809225984:0@lo:8:kworker.0 00000100:00080000:1.0:1783135722.817281:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135722.817290:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135722.817498:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135722.817597:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809226112:0@lo:8:kworker.0 00000100:00100000:3.0:1783135722.817646:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135722.822504:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809225984 00000100:00100000:1.0:1783135722.822522:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809225984 00000100:00100000:1.0:1783135722.822585:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809226112 00000100:00100000:1.0:1783135722.822589:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809226112 00000100:00100000:1.0:1783135722.822609:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135722.822617:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869752809225984:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783135722.822657:0:18573:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:1.0:1783135722.822689:0:18573:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628ee0d81 00002000:00100000:1.0:1783135722.822706:0:18573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ac5431df000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1783135722.822711:0:18573:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1783135722.822714:0:18573:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783135722.823366:0:18573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1783135722.823410:0:18573:0:(import.c:65:import_set_state_nolock()) ffff8ac5431da800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135722.823573:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1869752809225984:12345-0@lo:8:kworker.0 Request processed in 955us (6074us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135722.823582:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135722.823605:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135722.823610:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869752809226112:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783135722.823626:0:18573:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1783135722.825239:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac67f84fb80 x1869752809225984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135722.825259:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135722.825270:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1783135722.825280:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783135722.825286:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783135722.825290:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67f83f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783135722.825314:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783135722.825322:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809225984:0@lo:8:kworker.0 00000004:00080000:0.0:1783135722.827243:0:17808:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783135722.827276:0:17808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17808:1869752809226752:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1783135722.827373:0:17808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135722.827405:0:17808:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5de6c0 going to sleep for 11 seconds 00000004:00080000:0.0:1783135722.827428:0:17807:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783135722.827534:0:17807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 626620446217ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783135722.827542:0:17807:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1783135722.828039:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135722.828140:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809226624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135722.828177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135722.831391:0:18574:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783135722.831408:0:18574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1783135722.831515:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809226752 00000100:00100000:0.0:1783135722.831525:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809226752 00000100:00100000:0.0:1783135722.831648:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135722.831656:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17808:x1869752809226752:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1783135722.835126:0:18950:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783135722.835138:0:18950:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1783135722.835244:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17808:x1869752809226752:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3585us (7867us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135722.835257:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783135722.835317:0:17808:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac5438ad180 x1869752809226752/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783135738 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135722.835335:0:17808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17808:1869752809226752:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1783135722.835355:0:17808:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1783135722.835401:0:17808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17808:1869752809226880:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1783135722.835438:0:17808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135722.835463:0:17808:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac66b5de6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135722.835488:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809226880 00000100:00100000:0.0:1783135722.835505:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809226880 00000100:00100000:0.0:1783135722.835551:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135722.835559:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17808:x1869752809226880:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1783135722.835598:0:18574:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1783135722.835630:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17808:x1869752809226880:12345-0@lo:5:osp-pre-0-1.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135722.835637:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783135722.835666:0:17808:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac5438ad180 x1869752809226880/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135738 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135722.835676:0:17808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17808:1869752809226880:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1783135722.835684:0:17808:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000004:00080000:2.0:1783135722.838448:0:17798:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1783135722.838961:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809226624 00000100:00100000:3.0:1783135722.838973:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809226624 00000100:00100000:3.0:1783135722.839154:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135722.839166:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809226624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135722.839204:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783135722.839308:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809226624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (11129us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135722.839315:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783135722.839406:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac5438adc00 x1869752809226624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135722.839431:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809226624:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1783135722.841419:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135722.841602:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869752809226112:12345-0@lo:8:kworker.0 Request processed in 17985us (23950us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135722.841617:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1783135722.842226:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135722.842236:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783135722.842242:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f84f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809226112:0@lo:8:kworker.0 00010000:00010000:3.0:1783135722.863322:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135723.246906:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783135723.375254:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809227008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135723.375392:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135723.375454:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809227008 00000100:00100000:3.0:1783135723.375463:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809227008 00000100:00100000:3.0:1783135723.375515:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135723.375524:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809227008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135723.375560:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135723.375606:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809227008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135723.375612:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135723.375656:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544175180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809227008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135723.886344:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135723.886372:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809227136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135723.886466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135723.886568:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809227136 00000100:00100000:3.0:1783135723.886578:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809227136 00000100:00100000:3.0:1783135723.886637:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135723.886648:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809227136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135723.886686:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135723.886735:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809227136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135723.886743:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135723.886793:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809227136:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783135723.886964:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783135723.923360:0:18992:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135723.923591:0:18992:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1783135724.632364:0:19042:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135724.632555:0:19042:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783135724.910974:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135725.934439:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135726.895235:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135706/real 1783135706] req@ffff8ac67b3b0380 x1869752809216128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135726 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135726.895269:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac67b3b0380 x1869752809216128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135726 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135726.895279:0:3645:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135706/real 1783135706] req@ffff8ac67b3b2d80 x1869752809216256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135726 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135726.895289:0:3645:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ac67b3b2d80 x1869752809216256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135726 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135726.895317:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac544115000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135726.895337:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783135726.895342:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809216128:0@lo:8:kworker.0 00000100:00080000:0.0:1783135726.895351:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135726.895359:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783135726.895362:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809216256:0@lo:8:kworker.0 00000100:00080000:2.0:1783135726.895625:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135726.895630:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783135726.895633:0:468:0:(import.c:65:import_set_state_nolock()) ffff8ac544115000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135726.895638:0:468:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 610 00000100:00080000:2.0:1783135726.895643:0:468:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783135726.895650:0:468:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ac544115000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135726.895668:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac543b3dc00 x1869752809227520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135726.895681:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135726.895691:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783135726.895693:0:468:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135726.895697:0:468:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 610 00000100:00080000:2.0:1783135726.895699:0:468:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783135726.895704:0:468:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ac67c3d0800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135726.895717:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac543b3f480 x1869752809227648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135726.895753:0:468:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135726.895756:0:468:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783135726.895758:0:468:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135726.895761:0:468:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 626 00000100:00080000:2.0:1783135726.895763:0:468:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783135726.895766:0:468:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ac64b2cb800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135726.895775:0:468:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac543b3c700 x1869752809228160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135726.895845:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809227392:0@lo:400:kworker.0 00000100:00100000:1.0:1783135726.895914:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135726.895937:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809227264:0@lo:400:kworker.0 00000100:00100000:1.0:1783135726.895987:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809228288:0@lo:400:kworker.0 00000100:00100000:0.0:1783135726.896348:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135726.896442:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809227392 00000100:00100000:2.0:1783135726.896449:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809227392 00000100:00100000:2.0:1783135726.896515:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135726.896525:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809227392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135726.898119:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809227776:0@lo:400:kworker.0 00000100:00100000:2.0:1783135726.900201:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809227392:12345-0@lo:400:kworker.0 Request processed in 3670us (4279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135726.900218:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783135726.900313:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809228032:0@lo:400:kworker.0 00000100:00100000:0.0:1783135726.900353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135726.900439:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809228032 00000100:00100000:0.0:1783135726.900447:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809228032 00000100:00100000:0.0:1783135726.900538:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135726.900548:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809228032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135726.900606:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1869752809228032:12345-0@lo:400:kworker.0 Request processed in 61us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135726.900613:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135726.900642:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809227520:0@lo:8:kworker.0 00000100:00100000:0.0:1783135726.900669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135726.900687:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809227648:0@lo:8:kworker.0 00000100:00100000:0.0:1783135726.900709:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135726.900724:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809228160:0@lo:8:kworker.0 00000100:00100000:0.0:1783135726.900743:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135726.900779:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809227520 00000100:00100000:0.0:1783135726.900782:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809227520 00000100:00100000:0.0:1783135726.900800:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809227648 00000100:00100000:0.0:1783135726.900803:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809227648 00000100:00100000:0.0:1783135726.900813:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809228160 00000100:00100000:0.0:1783135726.900815:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809228160 00000100:00100000:0.0:1783135726.900823:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135726.900827:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1869752809227520:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783135726.900840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783135726.900867:0:18950:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 630 last 0 00000100:00100000:1.0:1783135726.900892:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809227392:0@lo:400:kworker.0 00000020:00000080:0.0:1783135726.900897:0:18950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628ee0d88 00002000:00100000:0.0:1783135726.900931:0:18950:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ac543691800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783135726.900936:0:18950:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:1.0:1783135726.900938:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809227264 00002000:00100000:0.0:1783135726.900940:0:18950:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783135726.900944:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809227264 00000100:00100000:1.0:1783135726.900989:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783135726.901193:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:3646:x1869752809227264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135726.901236:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:3646:x1869752809227264:12345-0@lo:400:kworker.0 Request processed in 47us (4889us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135726.901244:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00002000:00080000:0.0:1783135726.901267:0:18950:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783135726.901275:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135726.901290:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809228288 00000100:00080000:0.0:1783135726.901293:0:18950:0:(import.c:65:import_set_state_nolock()) ffff8ac543697800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135726.901294:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809228288 00000100:00100000:1.0:1783135726.901328:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135726.901335:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809228288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135726.901345:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1869752809227520:12345-0@lo:8:kworker.0 Request processed in 515us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135726.901353:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135726.901369:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135726.901374:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1869752809227648:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783135726.901381:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809228288:12345-0@lo:400:kworker.0 Request processed in 45us (541us total) trans 0 rc 0/0 00010000:00020000:0.0:1783135726.901388:0:18950:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135726.901392:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783135726.901424:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1869752809227648:12345-0@lo:8:kworker.0 Request processed in 48us (713us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135726.901430:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783135726.901441:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac543b3df80 x1869752809228288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135726.901446:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135726.901456:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1869752809228160:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783135726.901461:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809228288:0@lo:400:kworker.0 00010000:00020000:0.0:1783135726.901471:0:18950:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783135726.901519:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1869752809228160:12345-0@lo:8:kworker.0 Request processed in 64us (774us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783135726.901526:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783135726.901581:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac543b3dc00 x1869752809227520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135726.901591:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135726.901598:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783135726.901607:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783135726.901612:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783135726.901615:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac544115000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783135726.901728:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783135726.901735:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809227520:0@lo:8:kworker.0 00000100:00080000:0.0:1783135726.901749:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135726.901754:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783135726.901756:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809227648:0@lo:8:kworker.0 00000100:00080000:0.0:1783135726.901764:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135726.901767:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783135726.901769:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809228160:0@lo:8:kworker.0 00000004:00080000:0.0:1783135726.901797:0:17088:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783135726.901890:0:17088:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630694801573ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783135726.901899:0:17088:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1783135726.901945:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809227264:0@lo:400:kworker.0 00010000:00080000:0.0:1783135726.902262:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac543b3f100 x1869752809228032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135726.902276:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809228032:0@lo:400:kworker.0 00000004:00080000:1.0:1783135726.902937:0:17089:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1783135726.902973:0:17089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17089:1869752809228800:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783135726.903046:0:17089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135726.903075:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67c617600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135726.903304:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809228800 00000100:00100000:1.0:1783135726.903316:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809228800 00000100:00100000:3.0:1783135726.903317:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135726.903348:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809228416:0@lo:400:kworker.0 00000100:00100000:1.0:1783135726.903384:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135726.903385:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135726.903395:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17089:x1869752809228800:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783135726.903414:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783135726.903422:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809227904:0@lo:400:kworker.0 00000100:00100000:3.0:1783135726.903469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135726.903491:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809228544:0@lo:400:kworker.0 00000100:00100000:3.0:1783135726.903522:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135726.903576:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809227776 00000100:00100000:3.0:1783135726.903580:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809227776 00000100:00080000:1.0:1783135726.903593:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135726.903610:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809227904 00000100:00100000:3.0:1783135726.903614:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809228416 00000100:00100000:1.0:1783135726.903615:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809227904 00000100:00100000:3.0:1783135726.903620:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809228416 00000100:00100000:3.0:1783135726.903650:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809228544 00000100:00100000:1.0:1783135726.903656:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135726.903662:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809228544 00000100:00100000:1.0:1783135726.903668:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809227904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135726.903690:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135726.903699:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809227776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135726.903724:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809227904:12345-0@lo:400:kworker.0 Request processed in 57us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135726.903731:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135726.903750:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809227776:12345-0@lo:400:kworker.0 Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135726.903758:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135726.903770:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135726.903787:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135726.903794:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809228544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135726.903821:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809228544:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135726.903826:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783135726.905201:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809228672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135726.905299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135726.905500:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809228416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135726.905553:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809228416:12345-0@lo:400:kworker.0 Request processed in 1788us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135726.905562:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1783135726.905609:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135726.905614:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135726.905773:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809227904:0@lo:400:kworker.0 00010000:00080000:1.0:1783135726.905788:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac543b3c000 x1869752809228544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135726.905799:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809228544:0@lo:400:kworker.0 00010000:00080000:1.0:1783135726.905810:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac543b3ea00 x1869752809227776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135726.905819:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809227776:0@lo:400:kworker.0 00010000:00080000:1.0:1783135726.905846:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac543b3d500 x1869752809228416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135726.905855:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809228416:0@lo:400:kworker.0 00000100:00100000:0.0:1783135726.907333:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809228672 00000100:00100000:0.0:1783135726.907346:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809228672 00000100:00100000:0.0:1783135726.907437:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135726.907447:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1869752809228672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135726.907478:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783135726.907563:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1869752809228672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135726.907569:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783135726.907660:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac5441bd500 x1869752809228672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135726.907689:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809228672:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1783135726.908013:0:18950:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1783135726.908021:0:18950:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1783135726.908027:0:18950:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1783135726.918621:0:17044:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1783135726.918735:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.918747:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0d8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.918766:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.918770:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.918777:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0d8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.918792:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0d8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.918800:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0d8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.918805:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0d8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.918820:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135726.918847:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135726.918854:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0d8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.918872:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909a00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.918877:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0d8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.919050:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0d8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.919071:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0d8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.919247:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0d8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.919274:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.919275:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.919277:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.919602:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.919609:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0d96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.919624:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.919628:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.919633:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0d96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.919642:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0d96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.919650:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0d96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.919657:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0d96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.919677:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135726.919734:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135726.919739:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0d96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.919747:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909800 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.919751:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0d96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.919759:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0d96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.919771:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0d96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.919778:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0d96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.919792:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.919794:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.919796:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.920328:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.920335:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f34724/0xf7de4ef628ee0d9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.920344:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.920348:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.920352:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f34724/0xf7de4ef628ee0d9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.920360:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8f34724/0xf7de4ef628ee0d9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.920379:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8f34724/0xf7de4ef628ee0d9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.920387:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8f34724/0xf7de4ef628ee0d9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.920438:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135726.920821:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.920828:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002539bac7/0xf7de4ef628ee0da4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.920836:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.920839:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.920842:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002539bac7/0xf7de4ef628ee0da4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.920850:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002539bac7/0xf7de4ef628ee0da4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.920857:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002539bac7/0xf7de4ef628ee0da4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.920864:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002539bac7/0xf7de4ef628ee0da4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.922978:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135726.922992:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8f34724/0xf7de4ef628ee0d9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.923004:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908400 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135726.923009:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f34724/0xf7de4ef628ee0d9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.923018:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8f34724/0xf7de4ef628ee0d9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.923040:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8f34724/0xf7de4ef628ee0d9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.923046:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8f34724/0xf7de4ef628ee0d9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.923138:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135726.923622:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135726.923629:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002539bac7/0xf7de4ef628ee0da4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.923649:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908e00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.923653:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002539bac7/0xf7de4ef628ee0da4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.923660:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002539bac7/0xf7de4ef628ee0da4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.923671:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002539bac7/0xf7de4ef628ee0da4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.923677:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002539bac7/0xf7de4ef628ee0da4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.923692:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.923693:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.923695:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.923834:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.923841:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117c709d/0xf7de4ef628ee0dab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.923853:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.923857:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.923862:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000117c709d/0xf7de4ef628ee0dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.923874:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000117c709d/0xf7de4ef628ee0dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.923883:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000117c709d/0xf7de4ef628ee0dab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.923891:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000117c709d/0xf7de4ef628ee0dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.923910:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135726.924238:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135726.924243:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000117c709d/0xf7de4ef628ee0dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.924251:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909600 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.924255:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000117c709d/0xf7de4ef628ee0dab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.924262:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000117c709d/0xf7de4ef628ee0dab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.924280:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000117c709d/0xf7de4ef628ee0dab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.924286:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000117c709d/0xf7de4ef628ee0dab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.924301:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.924303:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.924304:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.924408:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.924414:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa4e4181/0xf7de4ef628ee0db2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.924422:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.924431:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.924436:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4e4181/0xf7de4ef628ee0db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.924446:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa4e4181/0xf7de4ef628ee0db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.924455:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa4e4181/0xf7de4ef628ee0db2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.924462:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4e4181/0xf7de4ef628ee0db2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.924482:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135726.924726:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135726.924731:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa4e4181/0xf7de4ef628ee0db2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.924739:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908c00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.924742:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4e4181/0xf7de4ef628ee0db2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.924750:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4e4181/0xf7de4ef628ee0db2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.924761:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa4e4181/0xf7de4ef628ee0db2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.924768:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa4e4181/0xf7de4ef628ee0db2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.924795:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.924797:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.924799:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.924884:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.924890:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0db9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.924898:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.924901:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.924905:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.924914:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.924930:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.924943:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.924967:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135726.925241:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135726.925247:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.925255:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909c00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.925258:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.925263:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0db9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.925270:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0db9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.925274:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5fa4af8/0xf7de4ef628ee0db9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.925284:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.925285:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.925287:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.925361:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.925365:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c37fbcbc/0xf7de4ef628ee0dc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.925371:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.925373:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.925376:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c37fbcbc/0xf7de4ef628ee0dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.925382:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c37fbcbc/0xf7de4ef628ee0dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.925390:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c37fbcbc/0xf7de4ef628ee0dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.925398:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c37fbcbc/0xf7de4ef628ee0dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.925418:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135726.925632:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135726.925637:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c37fbcbc/0xf7de4ef628ee0dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.925655:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.925658:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c37fbcbc/0xf7de4ef628ee0dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.925666:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c37fbcbc/0xf7de4ef628ee0dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.925677:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c37fbcbc/0xf7de4ef628ee0dc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.925684:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c37fbcbc/0xf7de4ef628ee0dc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.925699:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.925701:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.925702:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.925777:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.925783:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0dc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.925797:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.925800:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.925804:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.925813:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.925820:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.925826:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.925876:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135726.928747:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.928765:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001883d9b6/0xf7de4ef628ee0dce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.928782:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.928787:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.928793:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001883d9b6/0xf7de4ef628ee0dce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.928808:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001883d9b6/0xf7de4ef628ee0dce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.928831:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001883d9b6/0xf7de4ef628ee0dce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.928839:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001883d9b6/0xf7de4ef628ee0dce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.929075:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135726.929082:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.929121:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909a00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135726.929127:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.929136:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.929158:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0dc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.929165:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c3d7c76/0xf7de4ef628ee0dc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.929186:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135726.929195:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001883d9b6/0xf7de4ef628ee0dce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.929202:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135726.929205:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001883d9b6/0xf7de4ef628ee0dce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.929213:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001883d9b6/0xf7de4ef628ee0dce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.929224:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001883d9b6/0xf7de4ef628ee0dce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.929231:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135726.929232:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.929285:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135726.935342:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783135726.935361:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001883d9b6/0xf7de4ef628ee0dce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135726.935982:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.936002:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0dd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.936017:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.936021:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.936028:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.936042:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.936052:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.936073:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.936117:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135726.936533:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.936539:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88fefc8/0xf7de4ef628ee0ddc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.936548:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.936551:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.936555:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c88fefc8/0xf7de4ef628ee0ddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.936564:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c88fefc8/0xf7de4ef628ee0ddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.936572:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c88fefc8/0xf7de4ef628ee0ddc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.936579:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c88fefc8/0xf7de4ef628ee0ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.936588:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783135726.936846:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135726.936854:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.936862:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909800 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.936867:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.936890:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0dd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.936909:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0dd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.936917:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad091580/0xf7de4ef628ee0dd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.936947:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135726.936950:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c88fefc8/0xf7de4ef628ee0ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.936966:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8000 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.936970:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88fefc8/0xf7de4ef628ee0ddc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.936977:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c88fefc8/0xf7de4ef628ee0ddc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.936987:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c88fefc8/0xf7de4ef628ee0ddc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.937115:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c88fefc8/0xf7de4ef628ee0ddc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.937142:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.937144:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.937146:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.937152:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.937264:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.937271:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4484925/0xf7de4ef628ee0de3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.937287:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.937290:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.937295:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4484925/0xf7de4ef628ee0de3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.937304:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4484925/0xf7de4ef628ee0de3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.937312:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4484925/0xf7de4ef628ee0de3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.937318:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4484925/0xf7de4ef628ee0de3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.937338:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135726.937619:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.937626:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090de5818/0xf7de4ef628ee0dea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.937634:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.937637:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.937641:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090de5818/0xf7de4ef628ee0dea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.937650:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090de5818/0xf7de4ef628ee0dea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.937669:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090de5818/0xf7de4ef628ee0dea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.937676:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090de5818/0xf7de4ef628ee0dea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.937691:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783135726.937951:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.938070:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4dd8761/0xf7de4ef628ee0df1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.938079:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.938082:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.938108:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4dd8761/0xf7de4ef628ee0df1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.938119:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4dd8761/0xf7de4ef628ee0df1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.938128:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4dd8761/0xf7de4ef628ee0df1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.938135:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4dd8761/0xf7de4ef628ee0df1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.938155:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1783135726.938396:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783135726.938402:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4484925/0xf7de4ef628ee0de3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938410:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.938414:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4484925/0xf7de4ef628ee0de3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938422:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4484925/0xf7de4ef628ee0de3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938436:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4484925/0xf7de4ef628ee0de3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938444:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4484925/0xf7de4ef628ee0de3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938463:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135726.938467:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090de5818/0xf7de4ef628ee0dea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938473:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9a00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.938482:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090de5818/0xf7de4ef628ee0dea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938490:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090de5818/0xf7de4ef628ee0dea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938501:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090de5818/0xf7de4ef628ee0dea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938507:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090de5818/0xf7de4ef628ee0dea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938519:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135726.938522:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4dd8761/0xf7de4ef628ee0df1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938528:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8a00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.938531:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4dd8761/0xf7de4ef628ee0df1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938539:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4dd8761/0xf7de4ef628ee0df1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938547:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4dd8761/0xf7de4ef628ee0df1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938555:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4dd8761/0xf7de4ef628ee0df1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.938574:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.938576:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.938578:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.938586:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.938671:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.938677:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee0df8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.938686:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.938690:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.938694:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee0df8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.938703:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee0df8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.938710:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee0df8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.938717:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee0df8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.938737:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135726.939287:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135726.939293:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee0df8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.939301:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8e00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.939304:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee0df8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.939311:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee0df8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.939324:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee0df8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.939330:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009216cd3f/0xf7de4ef628ee0df8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.939345:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.939346:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.939348:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.940302:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.940314:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0dff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.940330:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.940343:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.940349:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0dff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.940363:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0dff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.940372:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0dff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.940379:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0dff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.940450:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135726.942633:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135726.942647:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0dff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.942660:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9e00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135726.942665:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0dff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.942675:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0dff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.942701:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0dff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.942716:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0dff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.942737:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135726.942739:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135726.942740:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135726.945858:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135726.950499:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135726.950515:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000130e0b6d/0xf7de4ef628ee0e06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.950539:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=630s v=(0 0) 00010000:00010000:3.0:1783135726.950544:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135726.950550:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000130e0b6d/0xf7de4ef628ee0e06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.950564:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000130e0b6d/0xf7de4ef628ee0e06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.950575:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000130e0b6d/0xf7de4ef628ee0e06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.950583:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000130e0b6d/0xf7de4ef628ee0e06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.950615:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135726.952168:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135726.952181:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aecd40d2/0xf7de4ef628ee0e0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.952197:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=630s v=(0 0) 00010000:00010000:3.0:1783135726.952201:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135726.952207:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aecd40d2/0xf7de4ef628ee0e0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.952220:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aecd40d2/0xf7de4ef628ee0e0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.952244:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aecd40d2/0xf7de4ef628ee0e0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.952252:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aecd40d2/0xf7de4ef628ee0e0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.952269:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135726.952697:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135726.952705:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000130e0b6d/0xf7de4ef628ee0e06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.952714:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135726.952719:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000130e0b6d/0xf7de4ef628ee0e06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.952728:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000130e0b6d/0xf7de4ef628ee0e06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.952746:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000130e0b6d/0xf7de4ef628ee0e06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.952753:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000130e0b6d/0xf7de4ef628ee0e06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.952775:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135726.952778:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aecd40d2/0xf7de4ef628ee0e0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.952792:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527400 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135726.952795:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aecd40d2/0xf7de4ef628ee0e0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.952803:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aecd40d2/0xf7de4ef628ee0e0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.952813:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aecd40d2/0xf7de4ef628ee0e0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.952819:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aecd40d2/0xf7de4ef628ee0e0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.952832:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135726.952834:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135726.952836:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135726.952844:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135726.955209:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135726.955222:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f2a39fc/0xf7de4ef628ee0e14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.955238:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=630s v=(0 0) 00010000:00010000:3.0:1783135726.955243:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135726.955248:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f2a39fc/0xf7de4ef628ee0e14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.955260:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f2a39fc/0xf7de4ef628ee0e14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.955269:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f2a39fc/0xf7de4ef628ee0e14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.955276:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f2a39fc/0xf7de4ef628ee0e14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.955312:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135726.955992:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135726.956002:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f2a39fc/0xf7de4ef628ee0e14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.956011:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527c00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135726.956024:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f2a39fc/0xf7de4ef628ee0e14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.956034:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f2a39fc/0xf7de4ef628ee0e14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.956053:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f2a39fc/0xf7de4ef628ee0e14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.956061:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f2a39fc/0xf7de4ef628ee0e14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.956121:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135726.956123:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135726.956125:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135726.956330:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135726.956337:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee0e1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.956348:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=630s v=(0 0) 00010000:00010000:3.0:1783135726.956352:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135726.956356:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee0e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.956366:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee0e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.956374:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee0e1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.956381:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee0e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.956757:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135726.957514:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135726.957524:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094956cfd/0xf7de4ef628ee0e22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.957540:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=630s v=(0 0) 00010000:00010000:3.0:1783135726.957553:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135726.957559:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094956cfd/0xf7de4ef628ee0e22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.957571:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094956cfd/0xf7de4ef628ee0e22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.957591:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094956cfd/0xf7de4ef628ee0e22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.957599:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094956cfd/0xf7de4ef628ee0e22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.957747:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135726.957755:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee0e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.957763:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526a00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135726.957767:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee0e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.957776:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee0e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.957799:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee0e1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.957807:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee0e1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.957825:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135726.957829:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094956cfd/0xf7de4ef628ee0e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.957835:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527e00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135726.957839:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094956cfd/0xf7de4ef628ee0e22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.957847:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094956cfd/0xf7de4ef628ee0e22 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.957856:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094956cfd/0xf7de4ef628ee0e22 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.957864:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135726.957865:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135726.957867:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.958186:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135726.958193:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094956cfd/0xf7de4ef628ee0e22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135726.967024:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135726.967042:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001075c705/0xf7de4ef628ee0e29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.967060:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=630s v=(0 0) 00010000:00010000:1.0:1783135726.967065:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135726.967072:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001075c705/0xf7de4ef628ee0e29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.967114:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001075c705/0xf7de4ef628ee0e29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.967127:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001075c705/0xf7de4ef628ee0e29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135726.967141:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001075c705/0xf7de4ef628ee0e29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.967267:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135726.967276:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001075c705/0xf7de4ef628ee0e29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.967296:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20ee00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135726.967301:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001075c705/0xf7de4ef628ee0e29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.967309:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001075c705/0xf7de4ef628ee0e29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.967327:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001075c705/0xf7de4ef628ee0e29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.967413:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135726.967415:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135726.967417:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.968729:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135726.969865:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783135726.969881:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001075c705/0xf7de4ef628ee0e29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135726.969976:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135726.974081:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135726.974115:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee0e30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.974134:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=630s v=(0 0) 00010000:00010000:3.0:1783135726.974138:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135726.974145:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee0e30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.974159:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee0e30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.974177:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee0e30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.974185:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee0e30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.974207:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135726.976767:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135726.976781:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be6ebcd3/0xf7de4ef628ee0e37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.976798:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=630s v=(0 0) 00010000:00010000:3.0:1783135726.976802:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135726.976809:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6ebcd3/0xf7de4ef628ee0e37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.976822:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be6ebcd3/0xf7de4ef628ee0e37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.976832:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be6ebcd3/0xf7de4ef628ee0e37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.976839:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be6ebcd3/0xf7de4ef628ee0e37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.976869:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783135726.976881:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135726.976887:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee0e30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.976894:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526400 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135726.976898:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee0e30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.976906:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee0e30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.976996:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135726.977002:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be6ebcd3/0xf7de4ef628ee0e37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.977010:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526e00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135726.977013:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be6ebcd3/0xf7de4ef628ee0e37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.977020:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be6ebcd3/0xf7de4ef628ee0e37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.977033:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be6ebcd3/0xf7de4ef628ee0e37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.977053:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be6ebcd3/0xf7de4ef628ee0e37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.977073:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135726.977074:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135726.977076:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135726.977649:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.977657:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000280b686c/0xf7de4ef628ee0e3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.977668:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.977672:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.977678:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000280b686c/0xf7de4ef628ee0e3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.977688:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000280b686c/0xf7de4ef628ee0e3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.977696:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000280b686c/0xf7de4ef628ee0e3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.977703:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000280b686c/0xf7de4ef628ee0e3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.977722:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135726.978035:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135726.978047:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0e45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.978055:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1783135726.978059:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135726.978063:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0e45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.978072:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0e45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.978080:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0e45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.978107:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0e45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.978121:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1783135726.978153:0:18950:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1783135726.978254:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17089:x1869752809228800:12345-0@lo:5:osp-pre-0-0.0 Request processed in 74858us (75203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135726.978269:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135726.978326:0:17089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17089:1869752809228800:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783135726.978342:0:17089:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1783135726.978393:0:17089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17089:1869752809228928:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783135726.978429:0:17089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135726.978469:0:17089:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54328bc00 going to sleep for 11 seconds 00010000:00010000:2.0:1783135726.978486:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135726.978491:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000280b686c/0xf7de4ef628ee0e3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.978499:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8c00 already unused, calling callback (ffffffffc0ce1ce0) 00000100:00100000:0.0:1783135726.979103:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809228928 00000100:00100000:0.0:1783135726.979113:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809228928 00000100:00100000:0.0:1783135726.979155:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135726.979165:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17089:x1869752809228928:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783135726.979205:0:18575:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:2.0:1783135726.981054:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000280b686c/0xf7de4ef628ee0e3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.981072:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000280b686c/0xf7de4ef628ee0e3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.981113:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000280b686c/0xf7de4ef628ee0e3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.981121:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000280b686c/0xf7de4ef628ee0e3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.983382:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135726.983392:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0e45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.983405:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9c00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135726.983411:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0e45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.983422:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0e45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.983452:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0e45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.983458:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0e45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135726.983477:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135726.983478:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135726.983480:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135726.983579:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783135726.990630:0:18569:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1783135726.990685:0:18569:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783135726.990694:0:18569:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1783135726.990882:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee0e30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.990899:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c59af00d/0xf7de4ef628ee0e30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135726.990938:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.990941:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135726.990943:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135727.005558:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17089:x1869752809228928:12345-0@lo:5:osp-pre-0-0.0 Request processed in 26387us (27122us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783135727.005572:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135727.006033:0:17089:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1783135727.006044:0:17089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17089:1869752809228928:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783135727.006059:0:17089:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1783135727.983460:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135727.987485:0:17808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17808:1869752809229184:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1783135727.987560:0:17808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135727.987590:0:17808:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac64a530840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135727.988185:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809229056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783135727.988221:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135727.989493:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809229056 00000100:00100000:3.0:1783135727.989505:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809229056 00000100:00100000:3.0:1783135727.989605:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135727.989617:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809229056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135727.989657:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783135727.989734:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809229056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135727.989742:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135727.990763:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809229056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135727.990825:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809229184 00000100:00100000:3.0:1783135727.990831:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809229184 00000100:00100000:3.0:1783135727.990920:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783135727.990930:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17808:x1869752809229184:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1783135727.990967:0:18573:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1783135728.037849:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17808:x1869752809229184:12345-0@lo:5:osp-pre-0-1.0 Request processed in 46911us (50280us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783135728.037864:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135728.042655:0:17808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17808:1869752809229184:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1783135728.042684:0:17808:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1783135728.042746:0:17808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17808:1869752809229312:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783135728.042833:0:17808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135728.042877:0:17808:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54328bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135728.043015:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809229312 00000100:00100000:2.0:1783135728.043025:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809229312 00000100:00100000:2.0:1783135728.043177:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135728.043188:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17808:x1869752809229312:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783135728.043244:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17808:x1869752809229312:12345-0@lo:900:osp-pre-0-1.0 Request processed in 57us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135728.043251:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783135728.043301:0:17808:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac543b3d500 x1869752809229312/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783135744 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135728.043311:0:17808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17808:1869752809229312:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1783135728.494361:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135728.494390:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809229440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135728.494467:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135728.494705:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809229440 00000100:00100000:3.0:1783135728.494714:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809229440 00000100:00100000:3.0:1783135728.494772:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783135728.494783:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809229440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135728.494822:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135728.494879:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809229440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135728.494887:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135728.495119:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809229440:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783135729.006616:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135729.007366:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135729.007390:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809229568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135729.007467:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135729.007603:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809229568 00000100:00100000:1.0:1783135729.007611:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809229568 00000100:00100000:1.0:1783135729.007662:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783135729.007672:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809229568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783135729.007706:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783135729.007829:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809229568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135729.007836:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783135729.007960:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809229568:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783135730.032515:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135730.801719:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783135731.054983:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783135731.639230:0:19387:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783135731.639234:0:19387:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1783135731.639236:0:19387:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783135731.639358:0:19387:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8ac66fada000 00000020:01000004:2.0:1783135731.639378:0:19387:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783135731.639394:0:19387:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783135731.639409:0:19387:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ac66b58cd40) 00000020:00000080:2.0:1783135731.639426:0:19387:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783135731.707230:0:19387:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783135731.718675:0:19387:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783135731.718974:0:19387:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783135731.719539:0:19387:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783135731.719739:0:19387:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783135731.719974:0:19387:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783135731.720884:0:19387:0:(osd_scrub.c:1809:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1783135731.722036:0:19387:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783135731.722308:0:19387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783135731.722323:0:19387:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135731.722334:0:19387:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7de4ef628ee0e53 00000020:01000004:3.0:1783135731.722341:0:19387:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783135731.722362:0:19387:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783135731.722366:0:19387:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783135731.722508:0:19387:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783135731.722539:0:19387:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1783135731.722543:0:19387:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1783135731.742969:0:19387:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783135731.743008:0:19387:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.106@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1783135731.743012:0:19387:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783135731.743014:0:19387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783135731.743015:0:19387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135731.743016:0:19387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135731.743017:0:19387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135731.743019:0:19387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135731.743020:0:19387:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135731.743022:0:19387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135731.743023:0:19387:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135731.743026:0:19387:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1783135731.743028:0:19387:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135731.743029:0:19387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783135731.743030:0:19387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135731.743031:0:19387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135731.743032:0:19387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135731.743036:0:19387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135731.743037:0:19387:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135731.743038:0:19387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135731.743039:0:19387:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135731.743065:0:19387:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783135731.743083:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809229696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135731.743178:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.743228:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac659d690c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135731.743291:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809229696 00000100:00100000:3.0:1783135731.743299:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809229696 00000100:00100000:3.0:1783135731.743352:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135731.743360:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:19387:x1869752809229696:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135731.743460:0:17058:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783135731.743464:0:17058:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1783135731.743468:0:17058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783135731.744183:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:19387:x1869752809229696:12345-0@lo:253:mount.lustre.0 Request processed in 820us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135731.744193:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783135731.744279:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809229696:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135731.744290:0:19387:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783135731.744292:0:19387:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135731.744294:0:19387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783135731.744295:0:19387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135731.744296:0:19387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135731.744297:0:19387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135731.744298:0:19387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135731.744299:0:19387:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135731.744301:0:19387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135731.744302:0:19387:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783135731.744319:0:19387:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ac66fada000 from lustre-OST0001 10000000:01000000:2.0:1783135731.744342:0:19387:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1783135731.744345:0:19387:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783135731.744353:0:19387:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ac543598000 local copy 00010000:00010000:2.0:1783135731.744362:0:19387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135731.748676:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809229824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135731.748755:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.748881:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac659d69240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135731.749322:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809229824 00000100:00100000:1.0:1783135731.749331:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809229824 00000100:00100000:1.0:1783135731.749526:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783135731.749539:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:19387:x1869752809229824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135731.749658:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:19387:x1869752809229824:12345-0@lo:501:mount.lustre.0 Request processed in 122us (903us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135731.749680:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783135731.749753:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809229824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783135731.749776:0:19387:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783135731.749808:0:19387:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783135731.749816:0:19387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.749843:0:19387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac650988200/0xf7de4ef628ee0aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ab0 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135731.749893:0:19387:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ac66fada000 10000000:01000000:3.0:1783135731.749899:0:19387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783135731.749905:0:19387:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783135731.749907:0:19387:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135731.749912:0:19387:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783135731.749915:0:19387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783135731.749945:0:19387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527e00/0xf7de4ef628ee0e5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.749952:0:19387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c527e00/0xf7de4ef628ee0e5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.749962:0:19387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c527e00/0xf7de4ef628ee0e5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135731.749979:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809229952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135731.750011:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.750429:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543218000 going to sleep for 11 seconds 00000100:00100000:2.0:1783135731.750498:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809229952 00000100:00100000:2.0:1783135731.750504:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809229952 00000100:00100000:2.0:1783135731.750543:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783135731.750550:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:19387:x1869752809229952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135731.750569:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135731.750583:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac6413e9a00/0xf7de4ef628ee0e61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0e5a expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.750606:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac6413e9a00/0xf7de4ef628ee0e61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0e5a expref: 22 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.750616:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac6413e9a00/0xf7de4ef628ee0e61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0e5a expref: 22 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.750625:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9a00, rc 0) 00000100:00100000:2.0:1783135731.750668:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:19387:x1869752809229952:12345-0@lo:101:mount.lustre.0 Request processed in 118us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.750674:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783135731.750796:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809229952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135731.750810:0:19387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c527e00/0xf7de4ef628ee0e5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0e61 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.750819:0:19387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527e00/0xf7de4ef628ee0e5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0e61 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135731.752061:0:19387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783135731.752970:0:19387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135731.755697:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783135731.755752:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783135731.755768:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783135731.755783:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783135731.755797:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783135731.755809:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783135731.755846:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783135731.755853:0:19387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783135731.755975:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135731.756052:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135731.756130:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317df00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135731.756215:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809230080 00000100:00100000:2.0:1783135731.756223:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809230080 00000100:00100000:2.0:1783135731.756274:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783135731.756283:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:19387:x1869752809230080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135731.756458:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:19387:x1869752809230080:12345-0@lo:501:mount.lustre.0 Request processed in 175us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.756466:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783135731.756733:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135731.756773:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135731.756818:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.756854:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543218600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135731.756942:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809230208 00000100:00100000:2.0:1783135731.756947:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809230208 00000100:00100000:2.0:1783135731.756976:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783135731.756983:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:19387:x1869752809230208:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135731.757687:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:19387:x1869752809230208:12345-0@lo:503:mount.lustre.0 Request processed in 702us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.757705:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783135731.757814:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783135731.758305:0:19387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135731.758392:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135731.758437:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.758466:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543218000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135731.758642:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809230336 00000100:00100000:1.0:1783135731.758648:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809230336 00000100:00100000:1.0:1783135731.758683:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783135731.758692:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:19387:x1869752809230336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135731.759301:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:19387:x1869752809230336:12345-0@lo:502:mount.lustre.0 Request processed in 609us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135731.759309:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783135731.759410:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135731.759634:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783135731.759661:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783135731.759693:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783135731.759707:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783135731.759718:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783135731.759730:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783135731.759741:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783135731.759752:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783135731.759767:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1783135731.759795:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135731.759849:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135731.759897:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135731.762934:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809230464 00000100:00100000:2.0:1783135731.762950:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809230464 00000100:00100000:2.0:1783135731.763024:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783135731.763036:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:19387:x1869752809230464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135731.763239:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:19387:x1869752809230464:12345-0@lo:502:mount.lustre.0 Request processed in 205us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.763247:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783135731.763517:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135731.763604:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1783135731.763617:0:19387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1783135731.764177:0:19391:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783135731.764186:0:19391:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1783135731.764192:0:19391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135731.764194:0:19391:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783135731.764200:0:19391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135731.764214:0:19391:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ac67c16b380) 00000020:00000080:1.0:1783135731.764239:0:19391:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783135731.764244:0:19391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783135731.764353:0:19391:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac66fada000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783135731.764361:0:19391:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783135731.764367:0:19391:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf7de4ef628ee0e6f 00010000:00010000:1.0:1783135731.772737:0:19391:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1783135731.773788:0:19391:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1783135731.775451:0:19391:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1783135731.782629:0:19391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783135731.782642:0:19391:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135731.782649:0:19391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135731.782652:0:19391:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783135731.782655:0:19391:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135731.782659:0:19391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135731.782661:0:19391:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135731.782664:0:19391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135731.782666:0:19391:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783135731.782668:0:19391:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135731.782671:0:19391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135731.782672:0:19391:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783135731.782675:0:19391:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135731.782677:0:19391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135731.782679:0:19391:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783135731.782682:0:19391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783135731.782715:0:19391:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135731.782718:0:19391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135731.782719:0:19391:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783135731.782723:0:19391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1783135731.782920:0:19387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1783135731.782954:0:19387:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783135731.782972:0:19387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c527e00/0xf7de4ef628ee0e5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0e61 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.782983:0:19387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c527e00/0xf7de4ef628ee0e5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0e61 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135731.782991:0:19387:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac66fada000 from 1 10000000:01000000:3.0:1783135731.782994:0:19387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135731.783030:0:19387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.783049:0:19387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.783061:0:19387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135731.783122:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544176680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135731.783198:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.783236:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543218780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135731.787560:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809230592 00000100:00100000:2.0:1783135731.787573:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809230592 00000100:00100000:2.0:1783135731.787638:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783135731.787647:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:19387:x1869752809230592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135731.787665:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135731.787682:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628ee0e7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0e76 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.787709:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628ee0e7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0e76 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.787720:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628ee0e7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0e76 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.787729:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e9200, rc 0) 00000100:00100000:2.0:1783135731.787792:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:19387:x1869752809230592:12345-0@lo:101:mount.lustre.0 Request processed in 146us (4595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.787799:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783135731.788491:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544176680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135731.788522:0:19387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.788534:0:19387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135731.792484:0:19387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1783135731.792764:0:19387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135731.794614:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1783135731.794689:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1783135731.794715:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1783135731.794721:0:19387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1783135731.794852:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544176680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135731.795614:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.795698:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543218000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135731.800406:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809230720 00000100:00100000:0.0:1783135731.800423:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809230720 00000100:00100000:0.0:1783135731.800549:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783135731.800561:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:19387:x1869752809230720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135731.800753:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:19387:x1869752809230720:12345-0@lo:501:mount.lustre.0 Request processed in 194us (5244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135731.800761:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783135731.807303:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544176680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135731.807366:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544176680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230848:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135731.807460:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.807548:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543218000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135731.809531:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809230848 00000100:00100000:0.0:1783135731.809544:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809230848 00000100:00100000:0.0:1783135731.809615:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783135731.809721:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:19387:x1869752809230848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135731.809898:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:19387:x1869752809230848:12345-0@lo:503:mount.lustre.0 Request processed in 179us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.809976:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544176680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135731.810479:0:19387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135731.810554:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135731.810604:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.810639:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135731.811588:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809230976 00000100:00100000:1.0:1783135731.811598:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809230976 00000100:00100000:0.0:1783135731.811804:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783135731.812789:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783135731.812809:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:19387:x1869752809230976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135731.813078:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:19387:x1869752809230976:12345-0@lo:502:mount.lustre.0 Request processed in 274us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135731.813106:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783135731.813490:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809230976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135731.814136:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783135731.814174:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783135731.814188:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783135731.814202:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783135731.814216:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783135731.814228:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783135731.814252:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783135731.814266:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1783135731.814280:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1783135731.814295:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1783135731.814310:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1783135731.814358:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135731.814816:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.817895:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135731.819251:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809231104 00000100:00100000:1.0:1783135731.819265:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809231104 00000100:00100000:0.0:1783135731.820259:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783135731.820270:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:19387:x1869752809231104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135731.820453:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:19387:x1869752809231104:12345-0@lo:502:mount.lustre.0 Request processed in 183us (5947us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135731.820461:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783135731.821296:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135731.821414:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1783135731.821430:0:19387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1783135731.822490:0:19395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135731.822502:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135731.822505:0:19395:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783135731.822520:0:19395:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac66fada000 00000020:00000080:1.0:1783135731.822523:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135731.822532:0:19395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135731.822534:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135731.822536:0:19395:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783135731.822539:0:19395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135731.822541:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135731.822543:0:19395:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783135731.822546:0:19395:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ac66fada000 00000020:00000080:1.0:1783135731.822548:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135731.822633:0:19395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135731.822637:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135731.822638:0:19395:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783135731.822641:0:19395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135731.822644:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135731.822646:0:19395:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783135731.822649:0:19395:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac66fada000 00000020:00000080:1.0:1783135731.822651:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135731.822669:0:19395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135731.822671:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135731.822673:0:19395:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783135731.822675:0:19395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135731.822678:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135731.822680:0:19395:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783135731.822683:0:19395:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ac66fada000 00000020:00000080:1.0:1783135731.822685:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135731.822703:0:19395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135731.822706:0:19395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135731.822707:0:19395:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783135731.822710:0:19395:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1783135731.824974:0:19387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783135731.825018:0:19387:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135731.825044:0:19387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.825058:0:19387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135731.825136:0:19387:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783135731.825139:0:19387:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ac66fada000 10000000:01000000:2.0:1783135731.825142:0:19387:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ac66fada000 10000000:01000000:2.0:1783135731.825146:0:19387:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135731.825151:0:19387:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8ac66fada000 from 1 10000000:01000000:2.0:1783135731.825154:0:19387:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135731.825188:0:19387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac6413e8000/0xf7de4ef628ee0e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.825196:0:19387:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac6413e8000/0xf7de4ef628ee0e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.825219:0:19387:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac6413e8000/0xf7de4ef628ee0e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135731.825243:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135731.825310:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.825347:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a240 going to sleep for 11 seconds 00000100:00100000:3.0:1783135731.826038:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809231232 00000100:00100000:3.0:1783135731.826048:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809231232 00000100:00100000:3.0:1783135731.826124:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783135731.826134:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:19387:x1869752809231232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135731.826149:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135731.826163:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c526800/0xf7de4ef628ee0e8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0e84 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.826187:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c526800/0xf7de4ef628ee0e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0e84 expref: 24 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.826197:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c526800/0xf7de4ef628ee0e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0e84 expref: 24 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.826205:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526800, rc 0) 00000100:00100000:3.0:1783135731.826253:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231232:12345-0@lo:101:mount.lustre.0 Request processed in 120us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135731.826259:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783135731.826329:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135731.826345:0:19387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac6413e8000/0xf7de4ef628ee0e84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0e8b expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.826355:0:19387:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac6413e8000/0xf7de4ef628ee0e84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0e8b expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135731.836123:0:19387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1783135731.837254:0:19387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135731.837962:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783135731.838001:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783135731.838016:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783135731.838027:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783135731.838039:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783135731.838051:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783135731.838065:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783135731.838078:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783135731.838131:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783135731.838147:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783135731.838160:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783135731.838173:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783135731.838186:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783135731.838199:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783135731.838228:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783135731.838242:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783135731.838256:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783135731.838269:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783135731.838281:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783135731.838293:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783135731.838306:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783135731.838318:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783135731.838343:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783135731.838356:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783135731.838367:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1783135731.838394:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1783135731.838408:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1783135731.838421:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1783135731.838433:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1783135731.838444:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1783135731.838471:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1783135731.838483:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1783135731.838493:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1783135731.838505:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1783135731.838517:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1783135731.838529:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1783135731.838542:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1783135731.838554:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1783135731.838566:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1783135731.838578:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1783135731.838592:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1783135731.838604:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1783135731.838614:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1783135731.839358:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1783135731.839446:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1783135731.839463:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1783135731.839518:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1783135731.839526:0:19387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1783135731.842979:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135731.843059:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.843995:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809231360 00000100:00100000:3.0:1783135731.844016:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809231360 00000100:00100000:3.0:1783135731.844070:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783135731.844079:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135731.844244:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231360:12345-0@lo:501:mount.lustre.0 Request processed in 165us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135731.844251:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783135731.844334:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135731.844360:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135731.844486:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231488:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135731.845001:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.845039:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135731.845983:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809231488 00000100:00100000:3.0:1783135731.845993:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809231488 00000100:00100000:3.0:1783135731.846049:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783135731.846059:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135731.846224:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e207450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231488:12345-0@lo:503:mount.lustre.0 Request processed in 166us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135731.846233:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783135731.846739:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231488:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135731.850220:0:19387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135731.850336:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135731.850439:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.850486:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135731.851753:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809231616 00000100:00100000:1.0:1783135731.851765:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809231616 00000100:00100000:1.0:1783135731.851823:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783135731.851846:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135731.852014:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e205850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231616:12345-0@lo:502:mount.lustre.0 Request processed in 170us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135731.852023:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783135731.852111:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135731.852338:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783135731.852366:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783135731.852380:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783135731.852393:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783135731.852406:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783135731.852420:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783135731.852432:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783135731.852444:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783135731.852457:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783135731.852470:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783135731.852483:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783135731.852496:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783135731.852507:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783135731.852519:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783135731.852531:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783135731.852544:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783135731.852557:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783135731.852569:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783135731.852581:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783135731.852593:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783135731.852606:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783135731.852635:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783135731.852650:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783135731.852680:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783135731.852695:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1783135731.852707:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1783135731.852730:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1783135731.852744:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1783135731.852758:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1783135731.852771:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1783135731.852784:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1783135731.852797:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1783135731.852810:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1783135731.852824:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1783135731.852850:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1783135731.852864:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1783135731.852875:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1783135731.852888:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1783135731.852901:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1783135731.852926:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1783135731.852940:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1783135731.852953:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1783135731.852965:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1783135731.852978:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1783135731.852991:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1783135731.853005:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1783135731.853017:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1783135731.853030:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1783135731.853077:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135731.853160:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135731.853207:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809231744 00000100:00100000:1.0:1783135731.853213:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809231744 00000100:00100000:1.0:1783135731.853246:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783135731.853253:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135731.853338:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e204450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231744:12345-0@lo:502:mount.lustre.0 Request processed in 85us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135731.853346:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783135731.853401:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6608689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135731.853417:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135731.853552:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1783135731.853573:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1783135731.853592:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135731.853623:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135731.853643:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809231872 00000100:00100000:1.0:1783135731.853647:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809231872 00000100:00100000:1.0:1783135731.853668:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783135731.853673:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e205450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135731.853727:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e205450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809231872:12345-0@lo:502:mount.lustre.0 Request processed in 53us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135731.853733:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1783135731.853760:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac660823240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135731.853770:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809231872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135731.853800:0:19387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1783135731.853807:0:19387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783135731.861294:0:19399:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783135731.861313:0:19399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ac67b4b99c0) 00000020:00000080:3.0:1783135731.861344:0:19399:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1783135731.861544:0:19399:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac66fada000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783135731.861548:0:19399:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac66fada000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783135731.861550:0:19399:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac66fada000 3 00010000:00080000:3.0:1783135731.861582:0:19399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac54257d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.106@tcp at head 00010000:00010000:3.0:1783135731.863507:0:19399:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1783135731.863935:0:19399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783135731.864047:0:19399:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783135731.864071:0:19399:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf7de4ef628ee0e99 00000100:00080000:2.0:1783135731.864082:0:19399:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135731.864104:0:19399:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ac54257d800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135731.864139:0:19399:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac543b3c700 x1869752809232000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135731.864161:0:19399:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783135731.864308:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135731.864312:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783135731.864314:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135731.864319:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 630 00000100:00080000:3.0:1783135731.864321:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783135731.864332:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ac67c3d0800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135731.864344:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac544174000 x1869752809232384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135731.864378:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135731.864381:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783135731.864382:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135731.864386:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 630 00000100:00080000:3.0:1783135731.864388:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783135731.864391:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ac64b2cb800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1783135731.864399:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac544177b80 x1869752809232896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135731.864439:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809232256:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.864509:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.864538:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809233024:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.864561:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.864579:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783135731.864583:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809232128:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.864604:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.864749:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809232768:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.864773:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.864801:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809232640:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.864823:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.864854:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809233280:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.864950:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.864974:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783135731.864981:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809232512:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.865000:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.865015:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809233152:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.865032:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.865219:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809232128 00000100:00100000:2.0:1783135731.865228:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809232128 00000100:00100000:2.0:1783135731.865266:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809232640 00000100:00100000:2.0:1783135731.865269:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809232640 00000100:00100000:2.0:1783135731.865286:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783135731.865294:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809232128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135731.865365:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809232128:12345-0@lo:400:kworker.0 Request processed in 71us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.865373:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783135731.865387:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135731.865393:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809232640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135731.865423:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809232640:12345-0@lo:400:kworker.0 Request processed in 31us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.865435:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135731.865456:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809233024 00000100:00100000:2.0:1783135731.865459:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809233024 00000100:00100000:2.0:1783135731.865476:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809233280 00000100:00100000:2.0:1783135731.865479:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809233280 00000100:00100000:2.0:1783135731.865503:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809232512 00000100:00100000:2.0:1783135731.865506:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809232512 00000100:00100000:2.0:1783135731.865515:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809233152 00000100:00100000:2.0:1783135731.865517:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809233152 00000100:00100000:2.0:1783135731.865529:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135731.865535:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809233024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135731.865565:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1869752809233024:12345-0@lo:400:kworker.0 Request processed in 30us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.865571:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135731.865580:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135731.865585:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809233280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135731.865609:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643476300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1869752809233280:12345-0@lo:400:kworker.0 Request processed in 23us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.865613:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783135731.865708:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809232256 00000100:00100000:3.0:1783135731.865712:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809232256 00000100:00100000:3.0:1783135731.865738:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809232768 00000100:00100000:3.0:1783135731.865740:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809232768 00000100:00100000:3.0:1783135731.865758:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135731.865765:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809232256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.865794:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643476a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809232256:12345-0@lo:400:kworker.0 Request processed in 31us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135731.865799:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135731.865811:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135731.865816:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1869752809232768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.865852:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1869752809232768:12345-0@lo:400:kworker.0 Request processed in 35us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135731.865858:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135731.866159:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869752809232000:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783135731.866200:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.866223:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809232000 00000100:00100000:0.0:1783135731.866225:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809232384:0@lo:8:kworker.0 00000100:00100000:3.0:1783135731.866226:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809232000 00000100:00100000:3.0:1783135731.866240:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783135731.866245:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.866247:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809232512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135731.866261:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809232896:0@lo:8:kworker.0 00000100:00100000:3.0:1783135731.866276:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1869752809232512:12345-0@lo:400:kworker.0 Request processed in 29us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135731.866279:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.866281:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135731.866293:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135731.866305:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809233152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.866332:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1869752809233152:12345-0@lo:400:kworker.0 Request processed in 28us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135731.866338:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135731.866349:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135731.866353:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809232000:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783135731.866375:0:17066:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:3.0:1783135731.866418:0:17066:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf7de4ef628ee0ea0 00000004:00100000:3.0:1783135731.866436:0:17066:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783135731.866466:0:17066:0:(import.c:65:import_set_state_nolock()) ffff8ac54257e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135731.866504:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1869752809232000:12345-0@lo:38:llog_process_th.0 Request processed in 149us (305us total) trans 0 rc 0/0 00000100:00080000:1.0:1783135731.866506:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135731.866510:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1783135731.866510:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135731.866512:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135731.866536:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809232384 00000100:00100000:3.0:1783135731.866539:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809232384 00000100:00100000:3.0:1783135731.866549:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809232896 00000100:00100000:3.0:1783135731.866552:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809232896 00000100:00100000:3.0:1783135731.866560:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135731.866564:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869752809232384:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783135731.866598:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869752809232384:12345-0@lo:8:kworker.0 Request processed in 32us (351us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783135731.866603:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135731.866614:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135731.866695:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869752809232896:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783135731.866735:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f84e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869752809232896:12345-0@lo:8:kworker.0 Request processed in 40us (454us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783135731.866741:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783135731.866780:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac543b3c700 x1869752809232000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135731.866790:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135731.866798:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1783135731.866806:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783135731.866810:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783135731.866813:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac54257d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783135731.866818:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1869752809232000:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783135731.866844:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135731.866848:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135731.866851:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783135731.866854:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809232384:0@lo:8:kworker.0 00000100:00100000:3.0:1783135731.866937:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135731.866942:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135731.866946:0:3645:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783135731.866949:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809232896:0@lo:8:kworker.0 00010000:00080000:3.0:1783135731.866989:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac544177100 x1869752809232512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135731.867000:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1869752809232512:0@lo:400:kworker.0 00010000:00080000:3.0:1783135731.867011:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac5438ad880 x1869752809233152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135731.867020:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5438ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1869752809233152:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.867030:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809232640:0@lo:400:kworker.0 00010000:00080000:3.0:1783135731.867278:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac643477800 x1869752809233280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135731.867289:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643477800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1869752809233280:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.867324:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809232128:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.867337:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809232768:0@lo:400:kworker.0 00000100:00100000:3.0:1783135731.867351:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809232256:0@lo:400:kworker.0 00010000:00080000:3.0:1783135731.867362:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac544177480 x1869752809233024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135731.867372:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1869752809233024:0@lo:400:kworker.0 00000020:01000004:2.0:1783135731.867904:0:19399:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783135731.867921:0:19399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ac66b588000) 00000020:00000080:2.0:1783135731.867945:0:19399:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1783135731.868179:0:19399:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ac66fada000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783135731.868183:0:19399:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ac66fada000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783135731.868186:0:19399:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8ac66fada000 3 00010000:00080000:2.0:1783135731.868217:0:19399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ac5425f8000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.106@tcp at head 00010000:00010000:2.0:1783135731.875448:0:19399:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1783135731.875559:0:19399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1783135731.875631:0:19399:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783135731.875645:0:19399:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf7de4ef628ee0eae 00000100:00080000:2.0:1783135731.875656:0:19399:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135731.875662:0:19399:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ac5425f8000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1783135731.875697:0:19399:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac543b3f480 x1869752809233408/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135731.875721:0:19399:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1783135731.875975:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869752809233408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783135731.876054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.877549:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809233408 00000100:00100000:2.0:1783135731.877563:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809233408 00000040:00080000:0.0:1783135731.879210:0:19399:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1783135731.879341:0:19387:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783135731.879371:0:19387:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783135731.879387:0:19387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac6413e8000/0xf7de4ef628ee0e84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0e8b expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135731.879399:0:19387:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac6413e8000/0xf7de4ef628ee0e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0e8b expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783135731.879462:0:19387:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783135731.879465:0:19387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783135731.879466:0:19387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135731.879468:0:19387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135731.879469:0:19387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135731.879470:0:19387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135731.879471:0:19387:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135731.879473:0:19387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135731.879474:0:19387:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783135731.879478:0:19387:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1783135731.879480:0:19387:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783135731.879481:0:19387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783135731.879482:0:19387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135731.879483:0:19387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135731.879484:0:19387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135731.879485:0:19387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135731.879486:0:19387:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135731.879487:0:19387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135731.879493:0:19387:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783135731.879530:0:19387:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783135731.879550:0:19387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809233536:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783135731.879618:0:19387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135731.879656:0:19387:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac65807a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135731.879692:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809233536 00000100:00100000:0.0:1783135731.879697:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809233536 00000100:00100000:0.0:1783135731.879737:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783135731.879746:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e204050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809233536:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135731.879773:0:17058:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783135731.879787:0:17058:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783135731.881400:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135731.881412:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1869752809233408:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783135731.881443:0:17066:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:2.0:1783135731.881483:0:17066:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf7de4ef628ee0eb5 00000004:00100000:2.0:1783135731.881503:0:17066:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783135731.881544:0:17066:0:(import.c:65:import_set_state_nolock()) ffff8ac5425fd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135731.881716:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1869752809233408:12345-0@lo:38:llog_process_th.0 Request processed in 304us (5662us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.881725:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783135731.881917:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ac543b3f480 x1869752809233408/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135731.881931:0:3645:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135731.881941:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1783135731.881950:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783135731.881956:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1783135731.881959:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac5425f8000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135731.881966:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1869752809233408:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1783135731.882508:0:17058:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783135731.882528:0:17058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783135731.883017:0:17080:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783135731.883024:0:17080:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783135731.883043:0:17080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.883072:0:17080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67e20e000/0xf7de4ef628ee0d6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d65 expref: 24 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.883080:0:17080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628ee0d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d73 expref: 24 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.883129:0:17080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.883168:0:17080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628ee0d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0d73 expref: 24 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.883182:0:17080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628ee0d7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d73 expref: 24 pid: 17058 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135731.883196:0:17080:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809233664:0@lo:104: 00000100:00100000:0.0:1783135731.883222:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e204050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:19387:x1869752809233536:12345-0@lo:253:mount.lustre.0 Request processed in 3476us (3602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.883231:0:17080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135731.883231:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:2.0:1783135731.883271:0:17080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67e20e000/0xf7de4ef628ee0d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0d65 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.883279:0:17080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67e20e000/0xf7de4ef628ee0d6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d65 expref: 23 pid: 17056 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135731.883287:0:17080:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809233792:0@lo:104: 00000100:00100000:2.0:1783135731.883309:0:17080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.883333:0:17080:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135731.883359:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809233664 00000100:00100000:2.0:1783135731.883365:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809233664 00000100:00100000:2.0:1783135731.883391:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809233792 00000100:00100000:2.0:1783135731.883394:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809233792 00000100:00100000:2.0:1783135731.883407:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135731.883414:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:17080:x1869752809233664:12345-0@lo:104: 00010000:00010000:2.0:1783135731.883428:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.883482:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135731.883488:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:17080:x1869752809233664:12345-0@lo:104: Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135731.883495:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135731.883510:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135731.883516:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:17080:x1869752809233792:12345-0@lo:104: 00010000:00010000:1.0:1783135731.883517:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135731.883523:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883524:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883532:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20fa00 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135731.883535:0:17053:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883554:0:17053:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135731.883560:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1783135731.883562:0:17053:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135731.883565:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:17080:x1869752809233792:12345-0@lo:104: Request processed in 50us (256us total) trans 0 rc 0/0 10000000:01000000:1.0:1783135731.883568:0:17053:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1783135731.883571:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1783135731.883597:0:17053:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135731.883601:0:17080:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809233664:0@lo:104: 00010000:00010000:1.0:1783135731.883604:0:17053:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783135731.883608:0:17080:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17080:1869752809233792:0@lo:104: 00010000:00010000:1.0:1783135731.883625:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883633:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67e20fa00/0xf7de4ef628ee0d73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0d7a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883646:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135731.883649:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883654:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527600 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:1.0:1783135731.883657:0:17053:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883663:0:17053:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135731.883669:0:17053:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135731.883680:0:17053:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135731.883694:0:17053:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883699:0:17053:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135731.883702:0:17080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883706:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883711:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c527600/0xf7de4ef628ee0d65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0d6c expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.883723:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135731.883725:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135731.883726:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135731.883737:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809233920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135731.883765:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135731.883961:0:19387:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:19387:1869752809233536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783135731.883971:0:19387:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783135731.883974:0:19387:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135731.883975:0:19387:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135731.883977:0:19387:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135731.883978:0:19387:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135731.883979:0:19387:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135731.883980:0:19387:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135731.883982:0:19387:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135731.883983:0:19387:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135731.883984:0:19387:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783135731.883994:0:19387:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1783135731.885328:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135731.886845:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135731.886862:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809234048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135731.886918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135731.888544:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809233920 00000100:00100000:2.0:1783135731.888559:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809233920 00010000:00010000:3.0:1783135731.888788:0:18599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628ee0d7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d73 expref: 24 pid: 17058 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135731.888848:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135731.888857:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3646:x1869752809233920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135731.888882:0:18599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135731.888889:0:18599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628ee0d7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d73 expref: 24 pid: 17058 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1783135731.888897:0:19387:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1783135731.888901:0:18599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628ee0d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d73 expref: 24 pid: 17058 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.888917:0:18599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20f200/0xf7de4ef628ee0d7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0d73 expref: 24 pid: 17058 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135731.888930:0:18599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135731.888986:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:3646:x1869752809233920:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (5219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135731.888994:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135731.890579:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809233920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135731.890621:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809234048 00000100:00100000:1.0:1783135731.890627:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809234048 00010000:00010000:1.0:1783135731.890653:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67e20e000/0xf7de4ef628ee0d6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d65 expref: 23 pid: 17056 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135731.890684:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135731.890692:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:3646:x1869752809234048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135731.890715:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135731.890720:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67e20e000/0xf7de4ef628ee0d6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d65 expref: 23 pid: 17056 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890731:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67e20e000/0xf7de4ef628ee0d6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d65 expref: 23 pid: 17056 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890746:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20e000/0xf7de4ef628ee0d6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0d65 expref: 23 pid: 17056 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890761:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890770:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783135731.890785:0:17050:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007761611s 00010000:00010000:1.0:1783135731.890790:0:17050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890797:0:17050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890804:0:17050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890810:0:17050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890815:0:17050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9e00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135731.890819:0:17050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890847:0:17050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890862:0:17050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890872:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135731.890920:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:3646:x1869752809234048:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (4001us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135731.890927:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135731.890959:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809234048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135731.890979:0:17080:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890987:0:17080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135731.890994:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac6413e9e00/0xf7de4ef628ee0ebc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783135731.891562:0:19387:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1783135731.891569:0:19387:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1783135731.891609:0:19387:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783135731.891652:0:19387:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783135731.892936:0:19387:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1783135731.892978:0:19387:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1783135731.893676:0:19387:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135731.893921:0:19387:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783135732.080026:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135732.082177:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809234176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135732.082270:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135732.082338:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809234176 00000100:00100000:3.0:1783135732.082348:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809234176 00000100:00100000:3.0:1783135732.082398:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135732.082405:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809234176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135732.082436:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783135732.082483:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809234176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135732.082491:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135732.082553:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809234176:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1783135732.864334:0:19455:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783135732.864643:0:19455:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1783135733.102331:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135733.102364:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809234304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1783135733.102470:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135733.102538:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809234304 00000100:00100000:3.0:1783135733.102549:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809234304 00000100:00080000:1.0:1783135733.102604:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135733.102626:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135733.102639:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869752809234304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783135733.102689:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783135733.103076:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1869752809234304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 439us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135733.103084:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135733.103261:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643475500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809234304:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1783135733.111179:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783135733.114636:0:18569:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 10000000:01000000:0.0:1783135733.426357:0:17061:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783135733.426365:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac5424bf000 from 10 10000000:01000000:0.0:1783135733.426370:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135733.426420:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b800/0xf7de4ef628ee0ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135733.426434:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b800/0xf7de4ef628ee0ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135733.426445:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b800/0xf7de4ef628ee0ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135733.426472:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809234432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135733.426554:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135733.426598:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543987600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135733.426653:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809234432 00000100:00100000:1.0:1783135733.426661:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809234432 00000100:00100000:1.0:1783135733.428463:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783135733.428482:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:17061:x1869752809234432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135733.428503:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135733.428524:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0eca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0ec3 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135733.428551:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ec3 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135733.428560:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20f600/0xf7de4ef628ee0eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ec3 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135733.428569:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f600, rc 0) 00000100:00100000:1.0:1783135733.428646:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e207c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:17061:x1869752809234432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135733.428653:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783135733.430256:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809234432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135733.430291:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b800/0xf7de4ef628ee0ec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0eca expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135733.430303:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b800/0xf7de4ef628ee0ec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0eca expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135733.430380:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643477100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809234560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783135733.430508:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135733.430564:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675342240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135733.431234:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809234560 00000100:00100000:0.0:1783135733.431244:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809234560 00000100:00100000:0.0:1783135733.431306:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783135733.431315:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e205c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:17061:x1869752809234560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783135733.431337:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783135733.431357:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783135733.431360:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1783135733.431464:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e205c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:17061:x1869752809234560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135733.431473:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783135733.432048:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643477100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809234560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783135733.432445:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783135733.432454:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b800/0xf7de4ef628ee0ec3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0eca expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135733.432470:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b800/0xf7de4ef628ee0ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0eca expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135733.432480:0:17061:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783135733.432483:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8ac678352000 from 10 10000000:01000000:3.0:1783135733.432486:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783135733.432516:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628ee0ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135733.432524:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628ee0ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135733.432533:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628ee0ed1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135733.432553:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643477100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809234688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135733.432592:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135733.432633:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675342240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135733.434028:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809234688 00000100:00100000:2.0:1783135733.434042:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809234688 00000100:00100000:2.0:1783135733.434122:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783135733.434132:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:17061:x1869752809234688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135733.434147:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135733.434164:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac6413e8c00/0xf7de4ef628ee0ed8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee0ed1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135733.434204:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac6413e8c00/0xf7de4ef628ee0ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ed1 expref: 24 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135733.434216:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac6413e8c00/0xf7de4ef628ee0ed8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ed1 expref: 24 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135733.434225:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac6413e8c00, rc 0) 00000100:00100000:2.0:1783135733.434292:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e204850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:17061:x1869752809234688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135733.434300:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783135733.435266:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643477100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809234688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135733.435287:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628ee0ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ed8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135733.435297:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628ee0ed1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee0ed8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135733.435364:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643477100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809234816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783135733.435414:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135733.435457:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675342240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135733.435543:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809234816 00000100:00100000:0.0:1783135733.435550:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809234816 00000100:00100000:0.0:1783135733.435589:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783135733.435597:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:17061:x1869752809234816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783135733.435616:0:17058:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783135733.435637:0:17058:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783135733.435640:0:17058:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1783135733.437239:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e206450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:17061:x1869752809234816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1636us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135733.437252:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1783135733.442568:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643477100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809234816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783135733.442662:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783135733.442674:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628ee0ed1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ed8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135733.442696:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c526e00/0xf7de4ef628ee0ed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee0ed8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135733.488523:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783135733.619413:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809234944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135733.619510:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135733.619631:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809234944 00000100:00100000:2.0:1783135733.619640:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809234944 00000100:00100000:2.0:1783135733.619706:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135733.619716:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809234944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783135733.619753:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135733.619812:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809234944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135733.619819:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135733.621585:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809234944:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783135734.126643:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135734.127051:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135734.127082:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809235072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783135734.127208:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135734.127494:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809235072 00000100:00100000:0.0:1783135734.127504:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809235072 00000100:00100000:0.0:1783135734.131991:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783135734.132028:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809235072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135734.132230:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783135734.132440:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809235072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 431us (5230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135734.132449:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783135734.132540:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809235072:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783135735.151238:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135736.174357:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.198204:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135737.199080:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809235200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135737.199202:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.199279:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809235200 00000100:00100000:0.0:1783135737.199287:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809235200 00000100:00100000:0.0:1783135737.199342:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135737.199351:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809235200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135737.199380:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783135737.199427:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809235200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135737.199434:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783135737.199572:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135737.199613:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809235200:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783135737.199769:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135737.199774:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135737.199777:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135737.199785:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ac67c3d0800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135737.199809:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac5441bc380 x1869752809235584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135737.199855:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135737.199858:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135737.199860:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135737.199865:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ac64b2cb800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1783135737.199876:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ac67b3b2d80 x1869752809236096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135737.199919:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809235456:0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.199953:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135737.199994:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809236224:0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.200019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135737.200037:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809236736:0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.200062:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135737.200081:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135737.200103:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809235712:0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.200127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135737.200143:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809236352:0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.200163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135737.200194:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809235456 00000100:00100000:1.0:1783135737.200198:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809235456 00000100:00100000:1.0:1783135737.200230:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783135737.200238:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809235456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.200281:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809235456:12345-0@lo:400:kworker.0 Request processed in 44us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135737.200288:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783135737.200317:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809236224 00000100:00100000:1.0:1783135737.200320:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809236224 00000100:00100000:1.0:1783135737.200338:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809236736 00000100:00100000:1.0:1783135737.200340:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809236736 00000100:00100000:1.0:1783135737.200360:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809235712 00000100:00100000:1.0:1783135737.200362:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809235712 00000100:00100000:1.0:1783135737.200373:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809236352 00000100:00100000:1.0:1783135737.200375:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809236352 00000100:00100000:1.0:1783135737.200390:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135737.200396:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809236224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.200428:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1869752809236224:12345-0@lo:400:kworker.0 Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135737.200434:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135737.200520:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135737.200527:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809236736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.200555:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1869752809236736:12345-0@lo:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135737.200561:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135737.200571:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135737.200577:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809235712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.200600:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1869752809235712:12345-0@lo:400:kworker.0 Request processed in 23us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135737.200606:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135737.200695:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135737.200703:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809236352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.200739:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809236352:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135737.200756:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1783135737.200804:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5441bd180 x1869752809235712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135737.200817:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1869752809235712:0@lo:400:kworker.0 00010000:00080000:1.0:1783135737.200826:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b0e00 x1869752809236352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135737.200834:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809236352:0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.200846:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809235456:0@lo:400:kworker.0 00010000:00080000:1.0:1783135737.200854:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b0380 x1869752809236224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135737.200861:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1869752809236224:0@lo:400:kworker.0 00010000:00080000:1.0:1783135737.200869:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b1c00 x1869752809236736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135737.200876:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1869752809236736:0@lo:400:kworker.0 00000100:00100000:0.0:1783135737.201745:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809235840:0@lo:400:kworker.0 00000100:00100000:0.0:1783135737.201797:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.201835:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809236480:0@lo:400:kworker.0 00000100:00100000:0.0:1783135737.201858:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.201875:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783135737.201882:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809235328:0@lo:400:kworker.0 00000100:00100000:0.0:1783135737.201911:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.201946:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809235968:0@lo:400:kworker.0 00000100:00100000:0.0:1783135737.201967:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.201984:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809236608:0@lo:400:kworker.0 00000100:00100000:0.0:1783135737.202001:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.202029:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809235584:0@lo:8:kworker.0 00000100:00100000:0.0:1783135737.202051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.203605:0:3645:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809236096:0@lo:8:kworker.0 00000100:00100000:0.0:1783135737.203752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.203810:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809235328 00000100:00100000:0.0:1783135737.203817:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809235328 00000100:00100000:0.0:1783135737.203863:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783135737.203871:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e207050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3648:x1869752809235328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135737.203927:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e207050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3648:x1869752809235328:12345-0@lo:400:kworker.0 Request processed in 57us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135737.203934:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783135737.203966:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809235968 00000100:00100000:0.0:1783135737.203970:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809235968 00000100:00100000:0.0:1783135737.203999:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809235584 00000100:00100000:0.0:1783135737.204017:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809235584 00000100:00100000:0.0:1783135737.204029:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809236096 00000100:00100000:0.0:1783135737.204032:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809236096 00000100:00100000:0.0:1783135737.204041:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135737.204047:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809235968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135737.204080:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809235968:12345-0@lo:400:kworker.0 Request processed in 34us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135737.204105:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135737.204117:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135737.204121:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1869752809235584:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783135737.204149:0:18573:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:0.0:1783135737.204176:0:18573:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf7de4ef628ee0edf 00002000:00100000:0.0:1783135737.204189:0:18573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ac5441e3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1783135737.204193:0:18573:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1783135737.204196:0:18573:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1783135737.204860:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135737.204870:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3645:x1869752809236096:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783135737.204894:0:18950:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:2.0:1783135737.204915:0:18950:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf7de4ef628ee0ee6 00002000:00100000:2.0:1783135737.204923:0:18950:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8ac5425f8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1783135737.204933:0:18950:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1783135737.204936:0:18950:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783135737.204973:0:18950:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1783135737.204996:0:18950:0:(import.c:65:import_set_state_nolock()) ffff8ac5425fd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135737.205068:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3645:x1869752809236096:12345-0@lo:8:kworker.0 Request processed in 197us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135737.205076:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00080000:0.0:1783135737.206186:0:18573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783135737.206217:0:18573:0:(import.c:65:import_set_state_nolock()) ffff8ac5441e7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135737.206271:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1869752809235584:12345-0@lo:8:kworker.0 Request processed in 2148us (4219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135737.206280:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135737.206430:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809235840 00000100:00100000:1.0:1783135737.206439:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809235840 00000100:00100000:1.0:1783135737.206484:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783135737.206494:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809235840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.206539:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809235840:12345-0@lo:400:kworker.0 Request processed in 48us (4742us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135737.206545:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783135737.206565:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809236480 00000100:00100000:1.0:1783135737.206576:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809236480 00000100:00100000:1.0:1783135737.206605:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809236608 00000100:00100000:1.0:1783135737.206608:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809236608 00000100:00100000:1.0:1783135737.206643:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135737.206650:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809236480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.206685:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1869752809236480:12345-0@lo:400:kworker.0 Request processed in 35us (4825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135737.206692:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135737.206703:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135737.206709:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809236608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135737.206748:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809236608:12345-0@lo:400:kworker.0 Request processed in 39us (4744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135737.206754:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1783135737.206930:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5441bc380 x1869752809235584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135737.206946:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783135737.206954:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783135737.206959:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783135737.206962:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac67c3d0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783135737.206985:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783135737.206999:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1869752809235584:0@lo:8:kworker.0 00010000:00080000:0.0:1783135737.207016:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b2d80 x1869752809236096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135737.207027:0:3645:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1783135737.207032:0:3645:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783135737.207034:0:3645:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783135737.207036:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8ac64b2cb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783135737.207045:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783135737.207048:0:3645:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1869752809236096:0@lo:8:kworker.0 00000004:00080000:0.0:1783135737.207077:0:17090:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783135737.207176:0:17090:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 641000087780ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783135737.207182:0:17090:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:0.0:1783135737.207357:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135737.207363:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135737.207365:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135737.207387:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809235328:0@lo:400:kworker.0 00000100:00100000:0.0:1783135737.207400:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1783135737.207412:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809235968:0@lo:400:kworker.0 00010000:00080000:0.0:1783135737.207425:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b2680 x1869752809236608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135737.207434:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809236608:0@lo:400:kworker.0 00000100:00100000:0.0:1783135737.207446:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809235840:0@lo:400:kworker.0 00010000:00080000:0.0:1783135737.207456:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b1880 x1869752809236480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135737.207464:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1869752809236480:0@lo:400:kworker.0 00000004:00080000:1.0:1783135737.207920:0:17091:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1783135737.207943:0:17091:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17091:1869752809236992:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783135737.207988:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135737.208022:0:17091:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac64a530480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135737.208024:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809236992 00000100:00100000:2.0:1783135737.208032:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809236992 00000004:00080000:1.0:1783135737.208060:0:17810:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1783135737.208077:0:17810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17810:1869752809237248:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1783135737.208078:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135737.208116:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17091:x1869752809236992:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783135737.208131:0:17810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135737.208147:0:17810:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac64a530840 going to sleep for 11 seconds 00000004:00080000:1.0:1783135737.208162:0:17809:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783135737.208231:0:17809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 641001142325ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783135737.208237:0:17809:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1783135737.208264:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809237248 00000100:00100000:1.0:1783135737.208268:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809237248 00000100:00100000:1.0:1783135737.208296:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135737.208462:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17810:x1869752809237248:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1783135737.209002:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809236864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135737.209042:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.209079:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135737.209108:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809237120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783135737.209129:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.209153:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809236864 00000100:00100000:0.0:1783135737.209157:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809236864 00000100:00100000:0.0:1783135737.209176:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809237120 00000100:00100000:0.0:1783135737.209178:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809237120 00000100:00100000:0.0:1783135737.209188:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135737.209193:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1869752809236864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135737.209213:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783135737.209253:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1869752809236864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135737.209259:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135737.209275:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135737.209281:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1869752809237120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135737.209289:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783135737.212034:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1869752809237120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2743us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135737.212050:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1783135737.212199:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783135737.212245:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b9ad80 x1869752809236864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135737.212287:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809236864:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1783135737.213067:0:18950:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1783135737.213080:0:18950:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1783135737.213128:0:18950:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00010000:00080000:3.0:1783135737.213600:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b9a680 x1869752809237120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135737.213700:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809237120:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1783135737.214258:0:17044:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1783135737.214596:0:17798:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1783135737.227748:0:18575:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1783135737.227768:0:18575:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1783135737.227882:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17810:x1869752809237248:12345-0@lo:7:osp-pre-1-1.0 Request processed in 19415us (19744us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135737.227895:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1783135737.228156:0:17810:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543b99500 x1869752809237248/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783135753 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135737.228173:0:17810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17810:1869752809237248:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1783135737.228189:0:17810:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783135737.228237:0:17810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17810:1869752809237376:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783135737.228276:0:17810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135737.228301:0:17810:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675342840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135737.228740:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809237376 00000100:00100000:0.0:1783135737.228748:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809237376 00000100:00100000:0.0:1783135737.228827:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135737.228835:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17810:x1869752809237376:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1783135737.228865:0:18574:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1783135737.228901:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17810:x1869752809237376:12345-0@lo:5:osp-pre-1-1.0 Request processed in 67us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135737.228907:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1783135737.229026:0:17810:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac643474000 x1869752809237376/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135753 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135737.229060:0:17810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17810:1869752809237376:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1783135737.229071:0:17810:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1783135737.229124:0:17810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17810:1869752809237504:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1783135737.229151:0:17810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135737.229170:0:17810:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675342840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135737.229184:0:18575:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1783135737.229191:0:18575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1783135737.229295:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809237504 00000100:00100000:3.0:1783135737.229299:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809237504 00000100:00100000:3.0:1783135737.229472:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135737.229480:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17810:x1869752809237504:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1783135737.229508:0:18575:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1783135737.236767:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.236779:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b38e9bdb/0xf7de4ef628ee0eed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.236798:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.236803:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.236810:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b38e9bdb/0xf7de4ef628ee0eed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.236829:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b38e9bdb/0xf7de4ef628ee0eed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.236840:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b38e9bdb/0xf7de4ef628ee0eed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.236855:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b38e9bdb/0xf7de4ef628ee0eed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.236916:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135737.238012:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.238024:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0ef4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.238038:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.238043:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.238048:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.238060:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.238069:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0ef4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.238077:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0ef4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.238254:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135737.238262:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b38e9bdb/0xf7de4ef628ee0eed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.238272:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9800 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135737.238277:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b38e9bdb/0xf7de4ef628ee0eed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.238287:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b38e9bdb/0xf7de4ef628ee0eed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.238318:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b38e9bdb/0xf7de4ef628ee0eed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.238341:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b38e9bdb/0xf7de4ef628ee0eed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.238365:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135737.238369:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.238376:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9c00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135737.238379:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0ef4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.238386:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0ef4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.238396:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0ef4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.238403:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135737.238405:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135737.238407:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.239740:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783135737.239754:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ee7c60b/0xf7de4ef628ee0ef4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.239845:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135737.242609:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.242708:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee0efb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.242736:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.242741:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.242749:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee0efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.242765:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee0efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.242775:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee0efb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.242783:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee0efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.242811:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135737.244558:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.244570:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0f02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.244587:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.244597:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.244604:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0f02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.245738:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135737.245750:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee0efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.245823:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e8e00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.245829:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee0efb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.245838:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee0efb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.245862:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee0efb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.245869:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009216cd3f/0xf7de4ef628ee0efb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.245890:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.245891:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.245893:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.245957:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0f02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.245969:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0f02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.245976:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0f02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.246044:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135737.246873:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.246881:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee0f09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.246894:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.246899:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.246905:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee0f09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.247063:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135737.247070:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0f02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.247079:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac6413e9e00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.247101:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0f02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.247111:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0f02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.247126:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0f02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.247134:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005a04a8d/0xf7de4ef628ee0f02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.247150:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.247153:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.247154:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.247219:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee0f09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.247229:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee0f09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.247244:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee0f09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.247337:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135737.249880:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.249896:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.249928:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.249933:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.249939:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.249954:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.249965:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.249973:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.250983:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135737.250994:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee0f09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.251005:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c800 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135737.251010:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee0f09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.251021:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee0f09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.251044:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee0f09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.251052:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee0f09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.251081:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135737.251098:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.251106:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65ce00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135737.251109:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.251117:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.251127:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.251135:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.251137:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.251139:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.251522:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783135737.251530:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.253478:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135737.255387:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783135737.255401:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003964d210/0xf7de4ef628ee0f17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.255420:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=641s v=(0 0) 00010000:00010000:3.0:1783135737.255432:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135737.255438:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003964d210/0xf7de4ef628ee0f17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.255455:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003964d210/0xf7de4ef628ee0f17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.255466:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003964d210/0xf7de4ef628ee0f17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.255474:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003964d210/0xf7de4ef628ee0f17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135737.255531:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135737.264771:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135737.264787:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003964d210/0xf7de4ef628ee0f17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.264804:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527600 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135737.264809:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003964d210/0xf7de4ef628ee0f17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.264853:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003964d210/0xf7de4ef628ee0f17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.264876:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003964d210/0xf7de4ef628ee0f17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.264884:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003964d210/0xf7de4ef628ee0f17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.264912:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.264914:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135737.264916:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.264917:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.264929:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.264942:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.264947:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.264953:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.264966:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.264975:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.264981:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.265007:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135737.265561:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135737.265567:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.265577:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65ce00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135737.265581:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.265589:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.265601:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.265630:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000368f59b2/0xf7de4ef628ee0f1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.265646:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.265648:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.265650:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135737.267888:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.267903:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073553c77/0xf7de4ef628ee0f25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.267921:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.267925:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.267931:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073553c77/0xf7de4ef628ee0f25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.267945:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073553c77/0xf7de4ef628ee0f25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.267955:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073553c77/0xf7de4ef628ee0f25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.267964:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073553c77/0xf7de4ef628ee0f25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.269265:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783135737.269875:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.269890:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.269906:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.269910:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.269917:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.269931:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.269940:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.269947:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.272658:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135737.272672:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073553c77/0xf7de4ef628ee0f25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.272686:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64ae00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.272691:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073553c77/0xf7de4ef628ee0f25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.272702:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073553c77/0xf7de4ef628ee0f25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.272723:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073553c77/0xf7de4ef628ee0f25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.273248:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073553c77/0xf7de4ef628ee0f25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.273270:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135737.273274:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.273282:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64aa00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.273286:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.273294:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.273308:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.273317:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.273319:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.273322:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.280865:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783135737.280882:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.280968:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135737.282943:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.282955:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068fadeda/0xf7de4ef628ee0f33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.282972:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.282976:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.282989:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068fadeda/0xf7de4ef628ee0f33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283005:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068fadeda/0xf7de4ef628ee0f33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283015:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068fadeda/0xf7de4ef628ee0f33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283022:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068fadeda/0xf7de4ef628ee0f33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283048:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783135737.283346:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.283352:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8c98c39/0xf7de4ef628ee0f3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283359:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.283362:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.283365:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8c98c39/0xf7de4ef628ee0f3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283374:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8c98c39/0xf7de4ef628ee0f3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283382:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8c98c39/0xf7de4ef628ee0f3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283400:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8c98c39/0xf7de4ef628ee0f3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283421:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783135737.283678:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.283684:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000de37ca4/0xf7de4ef628ee0f41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283692:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.283694:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.283698:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000de37ca4/0xf7de4ef628ee0f41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283707:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000de37ca4/0xf7de4ef628ee0f41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283714:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000de37ca4/0xf7de4ef628ee0f41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.283722:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000de37ca4/0xf7de4ef628ee0f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283741:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135737.283744:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783135737.283748:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068fadeda/0xf7de4ef628ee0f33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283756:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64ba00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135737.283761:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068fadeda/0xf7de4ef628ee0f33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283777:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068fadeda/0xf7de4ef628ee0f33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283795:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068fadeda/0xf7de4ef628ee0f33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283802:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068fadeda/0xf7de4ef628ee0f33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283820:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135737.283824:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8c98c39/0xf7de4ef628ee0f3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283831:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64bc00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135737.283834:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8c98c39/0xf7de4ef628ee0f3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283842:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8c98c39/0xf7de4ef628ee0f3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283852:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8c98c39/0xf7de4ef628ee0f3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283859:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8c98c39/0xf7de4ef628ee0f3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283882:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135737.283886:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000de37ca4/0xf7de4ef628ee0f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283892:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64b000 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135737.283895:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000de37ca4/0xf7de4ef628ee0f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283904:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000de37ca4/0xf7de4ef628ee0f41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283914:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000de37ca4/0xf7de4ef628ee0f41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283922:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000de37ca4/0xf7de4ef628ee0f41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.283934:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.283935:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.283937:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135737.284084:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.284114:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b34385/0xf7de4ef628ee0f48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.284129:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.284132:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.284136:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b34385/0xf7de4ef628ee0f48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.284145:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b34385/0xf7de4ef628ee0f48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.284153:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b34385/0xf7de4ef628ee0f48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.284160:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b34385/0xf7de4ef628ee0f48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.284173:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1783135737.284260:0:19388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1783135737.284283:0:19388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1783135737.284287:0:19388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1783135737.284317:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135737.284322:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b34385/0xf7de4ef628ee0f48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.284335:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64b400 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135737.284338:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b34385/0xf7de4ef628ee0f48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.284346:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b34385/0xf7de4ef628ee0f48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.284357:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b34385/0xf7de4ef628ee0f48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.284364:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b34385/0xf7de4ef628ee0f48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.284378:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.284379:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.284381:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135737.284584:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17810:x1869752809237504:12345-0@lo:5:osp-pre-1-1.0 Request processed in 55101us (55428us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783135737.284596:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783135737.284751:0:17810:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1783135737.284759:0:17810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17810:1869752809237504:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1783135737.284776:0:17810:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1783135737.284835:0:17810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543797100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17810:1869752809237632:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1783135737.284872:0:17810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135737.284895:0:17810:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67b1f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135737.284966:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809237632 00000100:00100000:2.0:1783135737.284973:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809237632 00000100:00100000:2.0:1783135737.285023:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135737.285032:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17810:x1869752809237632:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1783135737.285080:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17810:x1869752809237632:12345-0@lo:900:osp-pre-1-1.0 Request processed in 50us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135737.285114:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:2.0:1783135737.285184:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.285191:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ecf55a/0xf7de4ef628ee0f4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.285209:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.285212:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.285218:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ecf55a/0xf7de4ef628ee0f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.285229:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ecf55a/0xf7de4ef628ee0f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.285238:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076ecf55a/0xf7de4ef628ee0f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.285247:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076ecf55a/0xf7de4ef628ee0f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.285261:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135737.285270:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135737.285274:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076ecf55a/0xf7de4ef628ee0f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.285281:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65da00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135737.285285:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ecf55a/0xf7de4ef628ee0f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.285292:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076ecf55a/0xf7de4ef628ee0f4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.285314:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076ecf55a/0xf7de4ef628ee0f4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.285321:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ecf55a/0xf7de4ef628ee0f4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.285335:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.285337:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.285339:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135737.286017:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.286025:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd4ea134/0xf7de4ef628ee0f56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.286035:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.286037:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.286043:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd4ea134/0xf7de4ef628ee0f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.286053:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd4ea134/0xf7de4ef628ee0f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.286061:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd4ea134/0xf7de4ef628ee0f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.286068:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd4ea134/0xf7de4ef628ee0f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.286118:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135737.286128:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135737.286132:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd4ea134/0xf7de4ef628ee0f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.286139:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c400 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135737.286143:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd4ea134/0xf7de4ef628ee0f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.286150:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd4ea134/0xf7de4ef628ee0f56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.286162:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd4ea134/0xf7de4ef628ee0f56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.286169:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd4ea134/0xf7de4ef628ee0f56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.286182:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.286184:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.286185:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1783135737.286830:0:17810:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543797100 x1869752809237632/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783135753 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135737.286846:0:17810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543797100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17810:1869752809237632:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1783135737.287004:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.287010:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d972b39/0xf7de4ef628ee0f5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.287020:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.287032:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.287037:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d972b39/0xf7de4ef628ee0f5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.287047:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d972b39/0xf7de4ef628ee0f5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.287055:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d972b39/0xf7de4ef628ee0f5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.287062:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d972b39/0xf7de4ef628ee0f5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.287104:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135737.287575:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135737.287583:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d972b39/0xf7de4ef628ee0f5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.287592:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65dc00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.287602:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d972b39/0xf7de4ef628ee0f5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.287610:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d972b39/0xf7de4ef628ee0f5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.287625:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d972b39/0xf7de4ef628ee0f5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.287632:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d972b39/0xf7de4ef628ee0f5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.287650:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.287652:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.287654:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.287675:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135737.288980:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.288993:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004573d520/0xf7de4ef628ee0f64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.289007:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.289012:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.289018:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004573d520/0xf7de4ef628ee0f64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.289030:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004573d520/0xf7de4ef628ee0f64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.289040:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004573d520/0xf7de4ef628ee0f64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.289054:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004573d520/0xf7de4ef628ee0f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.289074:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135737.289202:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135737.289210:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004573d520/0xf7de4ef628ee0f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.289218:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c000 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.289221:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004573d520/0xf7de4ef628ee0f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.289230:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004573d520/0xf7de4ef628ee0f64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.289245:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004573d520/0xf7de4ef628ee0f64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.289258:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004573d520/0xf7de4ef628ee0f64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.289275:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.289277:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.289279:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.289748:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135737.290046:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.290053:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b0690e9/0xf7de4ef628ee0f6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.290065:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.290068:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.290072:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b0690e9/0xf7de4ef628ee0f6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.290082:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b0690e9/0xf7de4ef628ee0f6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.290720:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b0690e9/0xf7de4ef628ee0f6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.290740:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b0690e9/0xf7de4ef628ee0f6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.290767:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135737.290849:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135737.290857:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b0690e9/0xf7de4ef628ee0f6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.290864:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65de00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.290868:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b0690e9/0xf7de4ef628ee0f6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.290876:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b0690e9/0xf7de4ef628ee0f6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.290892:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b0690e9/0xf7de4ef628ee0f6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.290899:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b0690e9/0xf7de4ef628ee0f6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.290919:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.290922:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.290923:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135737.291921:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.291931:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d4af62e/0xf7de4ef628ee0f72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.291950:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.291954:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.291960:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d4af62e/0xf7de4ef628ee0f72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.291972:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d4af62e/0xf7de4ef628ee0f72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.291981:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d4af62e/0xf7de4ef628ee0f72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.291989:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d4af62e/0xf7de4ef628ee0f72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.292058:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135737.297184:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783135737.297197:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000013c3961/0xf7de4ef628ee0f79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.297215:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1783135737.297220:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135737.297226:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000013c3961/0xf7de4ef628ee0f79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.297240:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000013c3961/0xf7de4ef628ee0f79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.297263:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000013c3961/0xf7de4ef628ee0f79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.297271:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000013c3961/0xf7de4ef628ee0f79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.299289:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135737.299304:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d4af62e/0xf7de4ef628ee0f72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.299320:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d600 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135737.299325:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d4af62e/0xf7de4ef628ee0f72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.299337:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d4af62e/0xf7de4ef628ee0f72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.299360:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d4af62e/0xf7de4ef628ee0f72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.299367:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d4af62e/0xf7de4ef628ee0f72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.301221:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135737.301712:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135737.301721:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000013c3961/0xf7de4ef628ee0f79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.301770:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.301872:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65cc00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135737.301877:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000013c3961/0xf7de4ef628ee0f79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.301888:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000013c3961/0xf7de4ef628ee0f79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.301906:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000013c3961/0xf7de4ef628ee0f79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.301913:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000013c3961/0xf7de4ef628ee0f79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135737.301933:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.301941:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.301943:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135737.302008:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.302016:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302027:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.302037:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.302043:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302056:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302065:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302073:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302106:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783135737.302390:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.302397:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec08f88f/0xf7de4ef628ee0f87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302406:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.302409:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.302414:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec08f88f/0xf7de4ef628ee0f87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302423:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec08f88f/0xf7de4ef628ee0f87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302432:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec08f88f/0xf7de4ef628ee0f87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302444:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec08f88f/0xf7de4ef628ee0f87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302460:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135737.302470:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135737.302474:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302481:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64aa00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135737.302485:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302493:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302505:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302512:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fad7e1fb/0xf7de4ef628ee0f80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302529:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135737.302532:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec08f88f/0xf7de4ef628ee0f87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302550:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64a600 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135737.302553:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec08f88f/0xf7de4ef628ee0f87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302560:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec08f88f/0xf7de4ef628ee0f87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302570:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec08f88f/0xf7de4ef628ee0f87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302577:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec08f88f/0xf7de4ef628ee0f87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.302588:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.302589:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.302591:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135737.303163:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.303171:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003536329f/0xf7de4ef628ee0f8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.303182:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.303185:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.303189:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003536329f/0xf7de4ef628ee0f8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.303200:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003536329f/0xf7de4ef628ee0f8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.303217:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003536329f/0xf7de4ef628ee0f8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.303224:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003536329f/0xf7de4ef628ee0f8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.303239:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135737.303624:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135737.303630:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003536329f/0xf7de4ef628ee0f8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.303638:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64b600 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.303642:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003536329f/0xf7de4ef628ee0f8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.303650:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003536329f/0xf7de4ef628ee0f8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.303663:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003536329f/0xf7de4ef628ee0f8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.303671:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003536329f/0xf7de4ef628ee0f8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.303689:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.303691:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.303693:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.303817:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135737.303872:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.303878:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8efc62a/0xf7de4ef628ee0f95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.303887:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.303890:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.303894:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8efc62a/0xf7de4ef628ee0f95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.303904:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8efc62a/0xf7de4ef628ee0f95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.303912:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8efc62a/0xf7de4ef628ee0f95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.303919:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8efc62a/0xf7de4ef628ee0f95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.303953:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135737.304753:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135737.304771:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8efc62a/0xf7de4ef628ee0f95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.304781:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64a800 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.304785:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8efc62a/0xf7de4ef628ee0f95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.304810:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8efc62a/0xf7de4ef628ee0f95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.304826:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8efc62a/0xf7de4ef628ee0f95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.304834:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8efc62a/0xf7de4ef628ee0f95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.304850:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.304852:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.304854:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135737.305028:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.305035:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1505f4c/0xf7de4ef628ee0f9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.305045:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.305048:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.305052:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1505f4c/0xf7de4ef628ee0f9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.305063:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1505f4c/0xf7de4ef628ee0f9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.305071:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1505f4c/0xf7de4ef628ee0f9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.305077:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1505f4c/0xf7de4ef628ee0f9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.305198:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783135737.307631:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783135737.307646:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000281dba31/0xf7de4ef628ee0fa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.307664:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=641s v=(0 0) 00010000:00010000:0.0:1783135737.307675:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135737.307682:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281dba31/0xf7de4ef628ee0fa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.307700:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000281dba31/0xf7de4ef628ee0fa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.307710:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000281dba31/0xf7de4ef628ee0fa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.307717:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000281dba31/0xf7de4ef628ee0fa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.309751:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135737.309827:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1505f4c/0xf7de4ef628ee0f9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.309841:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64be00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.309847:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1505f4c/0xf7de4ef628ee0f9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.309859:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1505f4c/0xf7de4ef628ee0f9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.309880:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1505f4c/0xf7de4ef628ee0f9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.309902:0:18220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1505f4c/0xf7de4ef628ee0f9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.309922:0:18220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135737.309925:0:18220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000281dba31/0xf7de4ef628ee0fa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.309932:0:18220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64a200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:1.0:1783135737.309935:0:18220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000281dba31/0xf7de4ef628ee0fa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.309943:0:18220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000281dba31/0xf7de4ef628ee0fa3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.309953:0:18220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000281dba31/0xf7de4ef628ee0fa3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.309960:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.309961:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135737.309963:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135737.310720:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.310825:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783135737.310835:0:18950:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000281dba31/0xf7de4ef628ee0fa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135737.314914:0:18950:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783135737.314931:0:18950:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003851015b/0xf7de4ef628ee0faa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.314951:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=641s v=(0 0) 00010000:00010000:1.0:1783135737.314956:0:18950:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135737.314978:0:18950:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003851015b/0xf7de4ef628ee0faa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.314992:0:18950:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003851015b/0xf7de4ef628ee0faa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.315003:0:18950:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003851015b/0xf7de4ef628ee0faa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.315010:0:18950:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003851015b/0xf7de4ef628ee0faa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135737.315078:0:18950:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783135737.315190:0:18950:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1783135737.315309:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17091:x1869752809236992:12345-0@lo:5:osp-pre-1-0.0 Request processed in 107215us (107315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135737.315321:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135737.317032:0:17091:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17091:1869752809236992:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783135737.317052:0:17091:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1783135737.317167:0:17091:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17091:1869752809237760:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783135737.317222:0:17091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135737.317253:0:17091:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5427056c0 going to sleep for 11 seconds 00010000:00010000:0.0:1783135737.317733:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135737.317743:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003851015b/0xf7de4ef628ee0faa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.317755:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f200 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135737.317814:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003851015b/0xf7de4ef628ee0faa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.317827:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003851015b/0xf7de4ef628ee0faa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.317861:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003851015b/0xf7de4ef628ee0faa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.317868:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003851015b/0xf7de4ef628ee0faa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18950 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135737.317888:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.317890:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135737.317892:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135737.317909:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809237760 00000100:00100000:0.0:1783135737.317916:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809237760 00000100:00100000:0.0:1783135737.317996:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783135737.318010:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17091:x1869752809237760:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783135737.318050:0:18574:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1783135737.331444:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17091:x1869752809237760:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13427us (14212us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783135737.331463:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783135737.331541:0:17091:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17091:1869752809237760:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783135737.331557:0:17091:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:1.0:1783135738.222236:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135738.222264:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809237888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135738.222338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135738.222394:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809237888 00000100:00100000:1.0:1783135738.222402:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809237888 00000100:00100000:1.0:1783135738.222456:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135738.222465:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809237888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783135738.222499:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135738.222569:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809237888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135738.222588:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135738.222656:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809237888:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783135738.223542:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783135738.354758:0:19746:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783135738.735246:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135738.735273:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809238016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135738.735349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135738.738280:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809238016 00000100:00100000:3.0:1783135738.738298:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809238016 00000100:00100000:3.0:1783135738.739933:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135738.739950:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809238016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135738.740354:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135738.740711:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809238016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 756us (5352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135738.740720:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783135738.742012:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809238016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783135739.246586:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135739.246615:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809238144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783135739.246709:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135739.246818:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135739.246969:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809238144 00000100:00100000:3.0:1783135739.246977:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809238144 00000100:00100000:3.0:1783135739.247028:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135739.247037:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809238144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135739.247073:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135739.247148:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809238144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135739.247156:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783135739.247708:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac643474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809238144:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1783135739.323072:0:19798:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783135739.323361:0:19798:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1783135740.014990:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1783135740.198027:0:19848:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783135740.198439:0:19848:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783135740.271609:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135740.485258:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135740.485331:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786080768 00000100:00100000:0.0:1783135740.485342:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786080768 00000100:00100000:0.0:1783135740.485396:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00100000:0.0:1783135740.485406:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e206850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2397:x1869752786080768:12345-192.168.204.6@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783135740.485445:0:17059:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 455f3cf7-16ee-408c-8389-ea23e4967612@192.168.204.6@tcp t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:0.0:1783135740.485475:0:17059:0:(genops.c:1406:class_connect()) connect: client 455f3cf7-16ee-408c-8389-ea23e4967612, cookie 0xf7de4ef628ee0fb1 00000100:00080000:0.0:1783135740.485614:0:17059:0:(import.c:65:import_set_state_nolock()) ffff8ac5441e5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135740.485709:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e206850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+5:2397:x1869752786080768:12345-192.168.204.6@tcp:250:mount.lustre.0 Request processed in 295us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135740.485717:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00100000:2.0:1783135740.501616:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135740.502622:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786080896 00000100:00100000:0.0:1783135740.502635:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786080896 00000100:00100000:0.0:1783135740.502717:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 118 00000100:00100000:0.0:1783135740.502729:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+5:14901:x1869752786080896:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135740.502746:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135740.502765:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e64b200/0xf7de4ef628ee0fb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140fd8 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135740.502793:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e64b200/0xf7de4ef628ee0fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fd8 expref: 6 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135740.502805:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e64b200/0xf7de4ef628ee0fb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fd8 expref: 6 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135740.502813:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64b200, rc 0) 00000100:00100000:0.0:1783135740.502897:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e207850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+6:14901:x1869752786080896:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 170us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135740.502904:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 118 00000100:00100000:3.0:1783135740.507182:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135740.507271:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786081024 00000100:00100000:2.0:1783135740.507290:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786081024 00000100:00100000:2.0:1783135740.507355:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 119 00000100:00100000:2.0:1783135740.507366:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+6:14901:x1869752786081024:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783135740.507509:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e204c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+6:14901:x1869752786081024:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 144us (337us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135740.507516:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 119 00000100:00100000:3.0:1783135740.512281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135740.514748:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786081152 00000100:00100000:2.0:1783135740.514765:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786081152 00000100:00100000:2.0:1783135740.514845:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 120 00000100:00100000:2.0:1783135740.514866:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e205050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+6:14901:x1869752786081152:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135740.514886:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135740.514905:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628ee0fbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f140fdf expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135740.514949:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628ee0fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fdf expref: 7 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135740.514961:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65c200/0xf7de4ef628ee0fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f140fdf expref: 7 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135740.514971:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c200, rc 0) 00000100:00100000:2.0:1783135740.515044:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e205050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+7:14901:x1869752786081152:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 181us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135740.515051:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 120 00000100:00100000:3.0:1783135740.519438:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135740.522239:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786081280 00000100:00100000:0.0:1783135740.522256:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786081280 00000100:00100000:0.0:1783135740.522387:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 121 00000100:00100000:0.0:1783135740.522399:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+7:14901:x1869752786081280:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783135740.522599:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+8:14901:x1869752786081280:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 202us (3172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135740.522607:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 121 00000100:00100000:3.0:1783135740.538901:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135740.539055:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786081408 00000100:00100000:2.0:1783135740.539065:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786081408 00000100:00100000:2.0:1783135740.539156:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 122 00000100:00100000:2.0:1783135740.539167:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+8:14901:x1869752786081408:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783135740.539341:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+8:14901:x1869752786081408:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 175us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135740.539350:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 122 00000100:00100000:3.0:1783135740.552897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135740.553033:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786081536 00000100:00100000:0.0:1783135740.553050:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786081536 00000100:00100000:0.0:1783135740.553175:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00100000:0.0:1783135740.553187:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+8:14920:x1869752786081536:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135740.553354:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+8:14920:x1869752786081536:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 168us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135740.553364:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00100000:3.0:1783135740.575058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135740.575223:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786081664 00000100:00100000:1.0:1783135740.575239:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786081664 00000100:00100000:1.0:1783135740.575329:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 124 00000100:00100000:1.0:1783135740.575340:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+8:14920:x1869752786081664:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135740.575979:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+8:14920:x1869752786081664:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 638us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135740.575988:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 124 00000100:00100000:3.0:1783135740.583540:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135740.586253:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786081792 00000100:00100000:2.0:1783135740.586273:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786081792 00000100:00100000:2.0:1783135740.587288:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 125 00000100:00100000:2.0:1783135740.587311:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+8:14920:x1869752786081792:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135740.591906:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+8:14920:x1869752786081792:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 1771us (5548us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135740.591944:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 125 00000100:00100000:3.0:1783135740.602607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135740.602796:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786081920 00000100:00100000:1.0:1783135740.602813:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786081920 00000100:00100000:1.0:1783135740.602949:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 126 00000100:00100000:1.0:1783135740.602961:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+8:14901:x1869752786081920:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135740.602982:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135740.603002:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20f400/0xf7de4ef628ee0fc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141010 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.603032:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20f400/0xf7de4ef628ee0fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141010 expref: 9 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.603043:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20f400/0xf7de4ef628ee0fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141010 expref: 9 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.603071:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f400, rc 0) 00000100:00100000:1.0:1783135740.603176:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+9:14901:x1869752786081920:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 218us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135740.603184:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 126 00000100:00100000:3.0:1783135740.608403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135740.609054:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786082048 00000100:00100000:0.0:1783135740.609072:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786082048 00000100:00100000:0.0:1783135740.609299:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 127 00000100:00100000:0.0:1783135740.609311:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+9:14901:x1869752786082048:12345-192.168.204.6@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783135740.609354:0:17059:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783135740.609381:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783135740.609385:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783135740.609389:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783135740.609393:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783135740.609400:0:17059:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1783135740.613082:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+9:14901:x1869752786082048:12345-192.168.204.6@tcp:256:mount.lustre.0 Request processed in 3762us (4683us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135740.613136:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 127 00000100:00100000:3.0:1783135740.620079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135740.620185:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786082176 00000100:00100000:1.0:1783135740.620197:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786082176 00000100:00100000:1.0:1783135740.620259:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 128 00000100:00100000:1.0:1783135740.620268:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac64137d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+9:14901:x1869752786082176:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135740.620340:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135740.620359:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20f800/0xf7de4ef628ee0fcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141017 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.620404:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20f800/0xf7de4ef628ee0fcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141017 expref: 10 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.620416:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20f800/0xf7de4ef628ee0fcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141017 expref: 10 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.620425:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20f800, rc 0) 00000100:00100000:1.0:1783135740.620495:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac64137d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+10:14901:x1869752786082176:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 227us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135740.620504:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 128 00000100:00100000:3.0:1783135740.623879:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135740.623955:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786082304 00000100:00100000:2.0:1783135740.623981:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786082304 00000100:00100000:2.0:1783135740.624031:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 129 00000100:00100000:2.0:1783135740.624041:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+10:14901:x1869752786082304:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783135740.624242:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+10:14901:x1869752786082304:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 191us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135740.624251:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 129 00000100:00100000:3.0:1783135740.628184:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135740.628449:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786082432 00000100:00100000:0.0:1783135740.628463:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786082432 00000100:00100000:0.0:1783135740.628735:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 130 00000100:00100000:0.0:1783135740.628749:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+10:14901:x1869752786082432:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783135740.628934:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+10:14901:x1869752786082432:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 178us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135740.628944:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 130 00000100:00100000:1.0:1783135740.637389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135740.638476:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786082560 00000100:00100000:2.0:1783135740.638491:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786082560 00000100:00100000:2.0:1783135740.638618:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 131 00000100:00100000:2.0:1783135740.638630:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+10:14925:x1869752786082560:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135740.638866:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+10:14925:x1869752786082560:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 237us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135740.638875:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 131 00000100:00100000:2.0:1783135740.645984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135740.647847:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786082688 00000100:00100000:0.0:1783135740.647922:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786082688 00000100:00100000:0.0:1783135740.647999:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 132 00000100:00100000:0.0:1783135740.648009:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+10:14925:x1869752786082688:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135740.648429:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+10:14925:x1869752786082688:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 419us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135740.648438:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 132 00000100:00100000:3.0:1783135740.652589:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135740.652680:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786082816 00000100:00100000:1.0:1783135740.652691:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786082816 00000100:00100000:1.0:1783135740.652760:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:1.0:1783135740.652784:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1869752786082816:12345-192.168.204.6@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783135740.652815:0:17772:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 07e1865a-1721-4bc6-87c1-03d8d78664fd@192.168.204.6@tcp t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:1.0:1783135740.653011:0:17772:0:(genops.c:1406:class_connect()) connect: client 07e1865a-1721-4bc6-87c1-03d8d78664fd, cookie 0xf7de4ef628ee0fd4 00000004:00100000:1.0:1783135740.653039:0:17772:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783135740.656245:0:17772:0:(import.c:65:import_set_state_nolock()) ffff8ac5425fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135740.656344:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:2397:x1869752786082816:12345-192.168.204.6@tcp:38:mount.lustre.0 Request processed in 3559us (3762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135740.656356:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:1.0:1783135740.658485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135740.658584:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786083072 00000100:00100000:2.0:1783135740.658594:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786083072 00000100:00100000:2.0:1783135740.658685:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:2.0:1783135740.658695:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1869752786083072:12345-192.168.204.6@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783135740.658735:0:17064:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 07e1865a-1721-4bc6-87c1-03d8d78664fd@192.168.204.6@tcp t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:2.0:1783135740.658789:0:17064:0:(genops.c:1406:class_connect()) connect: client 07e1865a-1721-4bc6-87c1-03d8d78664fd, cookie 0xf7de4ef628ee0fdb 00000004:00100000:2.0:1783135740.658816:0:17064:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783135740.659037:0:17064:0:(import.c:65:import_set_state_nolock()) ffff8ac5425fc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135740.659133:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:2397:x1869752786083072:12345-192.168.204.6@tcp:38:mount.lustre.0 Request processed in 437us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135740.659140:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:3.0:1783135740.661814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135740.661912:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135740.662142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135740.662174:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786082944 00000100:00100000:2.0:1783135740.662186:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786082944 00000100:00080000:0.0:1783135740.662226:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135740.662450:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786083328 00000100:00100000:1.0:1783135740.662455:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786083328 00000100:00100000:2.0:1783135740.662518:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786083200 00000100:00100000:2.0:1783135740.662522:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786083200 00000100:00080000:1.0:1783135740.662575:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135740.662616:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:2.0:1783135740.662685:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:0:x1869752786082944:12345-192.168.204.6@tcp:41:mount.lustre.0 00000100:00100000:0.0:1783135740.662784:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:0.0:1783135740.662794:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:0:x1869752786083200:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783135740.662828:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000004:00000024:2.0:1783135740.662829:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1783135740.663029:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:0:x1869752786082944:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 349us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135740.663037:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:0.0:1783135740.665988:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:0:x1869752786083200:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 3183us (3832us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135740.666005:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:0.0:1783135740.666195:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:0.0:1783135740.666206:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac643475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:14901:x1869752786083328:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783135740.666239:0:17772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783135740.666305:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac643475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:14901:x1869752786083328:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 101us (4393us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135740.666311:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:3.0:1783135740.668313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135740.668446:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786083456 00000100:00100000:2.0:1783135740.668456:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786083456 00000100:00100000:2.0:1783135740.668528:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:2.0:1783135740.668538:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:14901:x1869752786083456:12345-192.168.204.6@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783135740.668855:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:14901:x1869752786083456:12345-192.168.204.6@tcp:40:mount.lustre.0 Request processed in 317us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135740.668863:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1783135740.675436:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135740.675491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135740.675536:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135740.675772:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786083840 00000100:00100000:3.0:1783135740.675774:0:19680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786083584 00000100:00100000:3.0:1783135740.675783:0:19680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786083584 00000100:00100000:2.0:1783135740.675784:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786083840 00000100:00100000:3.0:1783135740.675832:0:19680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786083712 00000100:00100000:3.0:1783135740.675837:0:19680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786083712 00000100:00100000:2.0:1783135740.675845:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:2.0:1783135740.675858:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:14901:x1869752786083840:12345-192.168.204.6@tcp:900:mount.lustre.0 00000100:00100000:3.0:1783135740.675910:0:19680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:3.0:1783135740.675927:0:19680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1869752786083584:12345-192.168.204.6@tcp:8:mount.lustre.0 00000100:00100000:2.0:1783135740.675959:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:14901:x1869752786083840:12345-192.168.204.6@tcp:900:mount.lustre.0 Request processed in 103us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135740.675975:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00010000:00080000:3.0:1783135740.675982:0:19680:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 07e1865a-1721-4bc6-87c1-03d8d78664fd@192.168.204.6@tcp t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:3.0:1783135740.676015:0:19680:0:(genops.c:1406:class_connect()) connect: client 07e1865a-1721-4bc6-87c1-03d8d78664fd, cookie 0xf7de4ef628ee0fe2 00002000:00100000:3.0:1783135740.676027:0:19680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 07e1865a-1721-4bc6-87c1-03d8d78664fd/ffff8ac54257a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783135740.676046:0:19680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783135740.676228:0:19680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783135740.676253:0:19680:0:(import.c:65:import_set_state_nolock()) ffff8ac54257f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135740.676287:0:19680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:2397:x1869752786083584:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 369us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135740.676294:0:19680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:3.0:1783135740.676311:0:19680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:3.0:1783135740.676315:0:19680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1869752786083712:12345-192.168.204.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783135740.676331:0:19680:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 07e1865a-1721-4bc6-87c1-03d8d78664fd@192.168.204.6@tcp t0 exp 0000000000000000 cur 644 last 0 00000020:00000080:3.0:1783135740.676347:0:19680:0:(genops.c:1406:class_connect()) connect: client 07e1865a-1721-4bc6-87c1-03d8d78664fd, cookie 0xf7de4ef628ee0fe9 00002000:00100000:3.0:1783135740.676353:0:19680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 07e1865a-1721-4bc6-87c1-03d8d78664fd/ffff8ac54257c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783135740.676371:0:19680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783135740.676484:0:19680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783135740.676499:0:19680:0:(import.c:65:import_set_state_nolock()) ffff8ac54257d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135740.676520:0:19680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:2397:x1869752786083712:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 203us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135740.676526:0:19680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:3.0:1783135740.691798:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135740.692310:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786083968 00000100:00100000:1.0:1783135740.692322:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786083968 00000100:00100000:1.0:1783135740.692385:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:1.0:1783135740.692396:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:14901:x1869752786083968:12345-192.168.204.6@tcp:33:mount.lustre.0 00000004:00080000:3.0:1783135740.695544:0:17067:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3057us 00000004:00200000:1.0:1783135740.718238:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783135740.718412:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:14901:x1869752786083968:12345-192.168.204.6@tcp:33:mount.lustre.0 Request processed in 26011us (26618us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135740.718430:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:2.0:1783135740.907313:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135740.907760:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786084096 00000100:00100000:1.0:1783135740.907771:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786084096 00000100:00100000:1.0:1783135740.907835:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:1.0:1783135740.907845:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:14948:x1869752786084096:12345-192.168.204.6@tcp:101:mkdir.0 00010000:00010000:1.0:1783135740.907865:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135740.907892:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20ec00/0xf7de4ef628ee0ff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141048 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.907965:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee0ff7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.907988:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee0ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.908017:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee0ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135740.908288:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783135740.908293:0:17066:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783135740.908331:0:17066:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee0ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.908360:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20ec00/0xf7de4ef628ee0ff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141048 expref: 8 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.908379:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee0ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141048 expref: 7 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135740.908388:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6508cf200) 00010000:00010000:1.0:1783135740.908391:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135740.908394:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e600, rc 0) 00000100:00100000:1.0:1783135740.908466:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:14948:x1869752786084096:12345-192.168.204.6@tcp:101:mkdir.0 Request processed in 623us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135740.908474:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00010000:00010000:2.0:1783135741.297501:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135742.318383:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135742.318460:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135742.318500:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809238272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135742.318580:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135742.318728:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809238272 00000100:00100000:0.0:1783135742.318736:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809238272 00000100:00100000:0.0:1783135742.318826:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135742.318838:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869752809238272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135742.318871:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783135742.318933:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1869752809238272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135742.318941:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135742.319006:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809238272:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783135742.319460:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135742.319747:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809238528:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135742.319803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135742.319894:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809238528 00000100:00100000:0.0:1783135742.319902:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809238528 00000100:00100000:0.0:1783135742.319950:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135742.319958:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809238528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783135742.319982:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783135742.320022:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809238528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135742.320040:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1783135742.320120:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135742.320154:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809238528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135742.320193:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135742.320208:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809238400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135742.320243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135742.320276:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809238400 00000100:00100000:1.0:1783135742.320280:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809238400 00000100:00100000:1.0:1783135742.320309:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135742.320316:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809238400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135742.320345:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135742.320380:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809238400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135742.320387:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135742.320413:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809238784:0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.320461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783135742.320464:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135742.320482:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809238784 00000100:00100000:3.0:1783135742.320486:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809238784 00000100:00100000:1.0:1783135742.320511:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809238400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135742.320521:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783135742.320531:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809238784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.320533:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809239296:0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.320565:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135742.320582:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809238784:12345-0@lo:400:kworker.0 Request processed in 53us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135742.320589:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783135742.320592:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809239808:0@lo:400:kworker.0 00000100:00100000:3.0:1783135742.320617:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809239040:0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.320624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135742.320663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135742.320666:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809238784:0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.320682:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783135742.320690:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809239552:0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.320692:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809238912:0@lo:400:kworker.0 00000100:00100000:3.0:1783135742.320730:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135742.320752:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783135742.320757:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809238656:0@lo:400:kworker.0 00000100:00100000:3.0:1783135742.320786:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135742.320957:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809239168:0@lo:400:kworker.0 00000100:00100000:3.0:1783135742.320985:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135742.321003:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809239680:0@lo:400:kworker.0 00000100:00100000:3.0:1783135742.321023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135742.324700:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809239040 00000100:00100000:3.0:1783135742.324780:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809239040 00000100:00100000:3.0:1783135742.324958:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783135742.324969:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809239040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135742.325075:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809239040:12345-0@lo:400:kworker.0 Request processed in 107us (4411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135742.325083:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783135742.325154:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809239040:0@lo:400:kworker.0 00000100:00100000:3.0:1783135742.325207:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809238656 00000100:00100000:3.0:1783135742.325211:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809238656 00000100:00100000:3.0:1783135742.325241:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783135742.325248:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3646:x1869752809238656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135742.325386:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3646:x1869752809238656:12345-0@lo:400:kworker.0 Request processed in 138us (4599us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135742.325395:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783135742.325442:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809238656:0@lo:400:kworker.0 00000100:00100000:3.0:1783135742.325483:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809239168 00000100:00100000:3.0:1783135742.325487:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809239168 00000100:00100000:3.0:1783135742.325527:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135742.325534:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809239168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135742.325572:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809239168:12345-0@lo:400:kworker.0 Request processed in 38us (4585us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135742.325579:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1783135742.325610:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135742.328965:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809239296 00000100:00100000:1.0:1783135742.330665:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809239296 00000100:00100000:1.0:1783135742.330789:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809239808 00000100:00100000:1.0:1783135742.330793:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809239808 00000100:00100000:1.0:1783135742.330951:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809239552 00000100:00100000:1.0:1783135742.330955:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809239552 00000100:00100000:1.0:1783135742.330979:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809239680 00000100:00100000:1.0:1783135742.330983:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809239680 00000100:00100000:1.0:1783135742.331003:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135742.331404:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809239296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.331501:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809239296:12345-0@lo:400:kworker.0 Request processed in 314us (10935us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135742.331521:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135742.331545:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135742.331552:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809239808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.331595:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809239808:12345-0@lo:400:kworker.0 Request processed in 38us (10968us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135742.331601:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135742.331618:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135742.331625:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809239552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.331775:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809239552:12345-0@lo:400:kworker.0 Request processed in 145us (11040us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135742.331782:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135742.331795:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783135742.331942:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809239680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.331995:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809239680:12345-0@lo:400:kworker.0 Request processed in 192us (10969us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135742.332002:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1783135742.332028:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135742.332033:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135742.332047:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135742.332159:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809238912 00000100:00100000:2.0:1783135742.332165:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809238912 00000100:00100000:0.0:1783135742.332372:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783135742.332385:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809238912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135742.332420:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809238912:12345-0@lo:400:kworker.0 Request processed in 40us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135742.332426:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783135742.332510:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809239168:0@lo:400:kworker.0 00000100:00100000:0.0:1783135742.332523:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809239680:0@lo:400:kworker.0 00010000:00080000:0.0:1783135742.332536:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac541d93800 x1869752809239552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135742.332546:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809239552:0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.332796:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544176680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809238912:0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.332807:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809239424:0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.332913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135742.333024:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809239296:0@lo:400:kworker.0 00010000:00080000:1.0:1783135742.333037:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac541d92a00 x1869752809239808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135742.333058:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809239808:0@lo:400:kworker.0 00000100:00100000:2.0:1783135742.337564:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809239424 00000100:00100000:2.0:1783135742.337578:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809239424 00000100:00100000:2.0:1783135742.337696:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135742.337706:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809239424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135742.337789:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809239424:12345-0@lo:400:kworker.0 Request processed in 85us (4876us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135742.337796:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1783135742.337884:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135742.337923:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809239424:0@lo:400:kworker.0 00000100:00100000:1.0:1783135742.960432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135742.960550:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786084224 00000100:00100000:3.0:1783135742.960571:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786084224 00000100:00100000:3.0:1783135742.960675:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:3.0:1783135742.960688:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:15001:x1869752786084224:12345-192.168.204.6@tcp:41:lfs.0 00000004:00000024:3.0:1783135742.960728:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:1.0:1783135742.961149:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135742.961309:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:15001:x1869752786084224:12345-192.168.204.6@tcp:41:lfs.0 Request processed in 621us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135742.961320:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:3.0:1783135742.969839:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135742.969947:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786084352 00000100:00100000:0.0:1783135742.969959:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786084352 00000100:00100000:0.0:1783135742.970053:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:0.0:1783135742.970064:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:15001:x1869752786084352:12345-192.168.204.6@tcp:41:lfs.0 00000004:00000024:0.0:1783135742.970149:0:17772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783135742.970256:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:15001:x1869752786084352:12345-192.168.204.6@tcp:41:lfs.0 Request processed in 193us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135742.970265:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00080000:1.0:1783135742.970545:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783135742.982408:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135742.985723:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786084480 00000100:00100000:1.0:1783135742.985739:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786084480 00000100:00080000:3.0:1783135742.985979:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135742.986033:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1783135742.986044:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:15001:x1869752786084480:12345-192.168.204.6@tcp:13:lfs.0 00002000:00000024:1.0:1783135742.986071:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135742.986201:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:15001:x1869752786084480:12345-192.168.204.6@tcp:13:lfs.0 Request processed in 158us (3803us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135742.986209:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:0.0:1783135742.990764:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135742.990974:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786084608 00000100:00100000:2.0:1783135742.990984:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786084608 00000100:00100000:2.0:1783135742.991061:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:2.0:1783135742.991072:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:15001:x1869752786084608:12345-192.168.204.6@tcp:13:lfs.0 00002000:00000024:2.0:1783135742.991127:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783135742.991327:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:15001:x1869752786084608:12345-192.168.204.6@tcp:13:lfs.0 Request processed in 256us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135742.991334:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00080000:3.0:1783135742.991475:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135743.297807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135743.297880:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786084736 00000100:00100000:0.0:1783135743.297891:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786084736 00000100:00100000:0.0:1783135743.297948:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 134 00000100:00100000:0.0:1783135743.297973:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+10:15032:x1869752786084736:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135743.297992:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135743.298010:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e64be00/0xf7de4ef628ee0ffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f14104f expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135743.298039:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e64be00/0xf7de4ef628ee0ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14104f expref: 11 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135743.298051:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e64be00/0xf7de4ef628ee0ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14104f expref: 11 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135743.298061:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64be00, rc 0) 00000100:00100000:0.0:1783135743.298158:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+11:15032:x1869752786084736:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 187us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135743.298166:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 134 00000100:00100000:0.0:1783135743.307629:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135743.307752:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786084864 00000100:00100000:1.0:1783135743.307764:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786084864 00000100:00100000:1.0:1783135743.307823:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 135 00000100:00100000:1.0:1783135743.307833:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+11:15032:x1869752786084864:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783135743.308023:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+11:15032:x1869752786084864:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 191us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135743.308041:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 135 00000100:00100000:1.0:1783135743.320593:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135743.320839:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786084992 00000100:00100000:0.0:1783135743.320849:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786084992 00000100:00100000:0.0:1783135743.320902:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 136 00000100:00100000:0.0:1783135743.320911:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+11:15032:x1869752786084992:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783135743.321079:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+11:15032:x1869752786084992:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 167us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135743.321121:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 136 00000100:00100000:2.0:1783135743.327801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135743.332868:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786085120 00000100:00100000:3.0:1783135743.332887:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786085120 00000100:00100000:2.0:1783135743.333349:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 137 00000100:00100000:2.0:1783135743.333361:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+11:15039:x1869752786085120:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135743.333838:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+11:15039:x1869752786085120:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 477us (6044us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135743.333847:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 137 00010000:00010000:1.0:1783135743.346437:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135743.347952:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000001:00100000:0.0:1783135743.353147:0:19388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 07e1865a-1721-4bc6-87c1-03d8d78664fd 00000001:00080000:0.0:1783135743.353168:0:19388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1783135743.353401:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809239936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135743.353506:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135743.353608:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809239936 00000100:00100000:0.0:1783135743.353630:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809239936 00000100:00100000:0.0:1783135743.353911:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135743.353921:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809239936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783135743.353953:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783135743.354007:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809239936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135743.354014:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135743.354187:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543b3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809239936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135743.414834:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135743.415636:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786085248 00000100:00100000:1.0:1783135743.415649:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786085248 00000100:00100000:1.0:1783135743.416118:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 138 00000100:00100000:1.0:1783135743.416129:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+11:15039:x1869752786085248:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135743.416426:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+11:15039:x1869752786085248:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 296us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135743.416435:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 138 00000100:00100000:1.0:1783135743.422549:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135743.422894:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786085376 00000100:00100000:2.0:1783135743.422905:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786085376 00000100:00100000:2.0:1783135743.423043:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 139 00000100:00100000:2.0:1783135743.423054:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+11:15039:x1869752786085376:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135743.423251:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+11:15039:x1869752786085376:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 198us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135743.423259:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 139 00000100:00100000:3.0:1783135743.426667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135743.426722:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786085504 00000100:00100000:1.0:1783135743.426732:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786085504 00000100:00100000:1.0:1783135743.426787:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 140 00000100:00100000:1.0:1783135743.426797:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+11:15032:x1869752786085504:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135743.426812:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135743.426830:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee1005 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141080 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135743.426857:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee1005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141080 expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135743.426879:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e20ee00/0xf7de4ef628ee1005 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141080 expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135743.426888:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20ee00, rc 0) 00000100:00100000:1.0:1783135743.426955:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+12:15032:x1869752786085504:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 160us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135743.426978:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 140 00000100:00100000:3.0:1783135743.435015:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135743.435359:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786085632 00000100:00100000:0.0:1783135743.435369:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786085632 00000100:00100000:0.0:1783135743.435430:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 141 00000100:00100000:0.0:1783135743.435442:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+12:15032:x1869752786085632:12345-192.168.204.6@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783135743.435471:0:17059:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783135743.435496:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783135743.435500:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783135743.435503:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783135743.435505:0:17059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783135743.435508:0:17059:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1783135743.439586:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+12:15032:x1869752786085632:12345-192.168.204.6@tcp:256:mount.lustre.0 Request processed in 4133us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135743.439602:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 141 00000100:00100000:3.0:1783135743.446792:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135743.447347:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786085760 00000100:00100000:2.0:1783135743.447358:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786085760 00000100:00100000:2.0:1783135743.447423:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 142 00000100:00100000:2.0:1783135743.447433:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+12:15032:x1869752786085760:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135743.447451:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135743.447470:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65c600/0xf7de4ef628ee100c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141087 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135743.447499:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65c600/0xf7de4ef628ee100c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141087 expref: 13 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135743.447511:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65c600/0xf7de4ef628ee100c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141087 expref: 13 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135743.447535:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c600, rc 0) 00000100:00100000:2.0:1783135743.447595:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+13:15032:x1869752786085760:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 163us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135743.447602:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 142 00000100:00100000:3.0:1783135743.453571:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135743.454843:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786085888 00000100:00100000:2.0:1783135743.454857:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786085888 00000100:00100000:2.0:1783135743.454935:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 143 00000100:00100000:2.0:1783135743.454946:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c0f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+13:15032:x1869752786085888:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783135743.455566:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c0f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+13:15032:x1869752786085888:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 620us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135743.455575:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 143 00000100:00100000:0.0:1783135743.461350:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135743.461628:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786086016 00000100:00100000:2.0:1783135743.461640:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786086016 00000100:00100000:2.0:1783135743.461937:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 144 00000100:00100000:2.0:1783135743.461947:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+13:15032:x1869752786086016:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783135743.462168:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c510850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+13:15032:x1869752786086016:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 221us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135743.462176:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 144 00000100:00100000:3.0:1783135743.465752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135743.467466:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786086144 00000100:00100000:1.0:1783135743.467483:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786086144 00000100:00100000:1.0:1783135743.467548:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 145 00000100:00100000:1.0:1783135743.467558:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+13:15043:x1869752786086144:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135743.468031:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+13:15043:x1869752786086144:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 473us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135743.468039:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 145 00000100:00100000:3.0:1783135743.471602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135743.472136:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786086272 00000100:00100000:2.0:1783135743.472146:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786086272 00000100:00100000:0.0:1783135743.472340:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 146 00000100:00100000:0.0:1783135743.472353:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+13:15043:x1869752786086272:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135743.472532:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+13:15043:x1869752786086272:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 179us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135743.472541:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 146 00000100:00100000:3.0:1783135743.501078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135743.501160:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135743.501734:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786086400 00000100:00100000:0.0:1783135743.501746:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786086400 00000100:00100000:0.0:1783135743.501817:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786086656 00000100:00100000:0.0:1783135743.501821:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786086656 00000100:00100000:0.0:1783135743.501856:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:0.0:1783135743.501878:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1869752786086400:12345-192.168.204.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783135743.501906:0:17065:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 06406641-6839-4a1a-8419-9f7c420b54d1@192.168.204.6@tcp t0 exp 0000000000000000 cur 647 last 0 00000100:00100000:3.0:1783135743.501932:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:3.0:1783135743.501938:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1869752786086656:12345-192.168.204.6@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783135743.501954:0:17772:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 06406641-6839-4a1a-8419-9f7c420b54d1@192.168.204.6@tcp t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:3.0:1783135743.501977:0:17772:0:(genops.c:1406:class_connect()) connect: client 06406641-6839-4a1a-8419-9f7c420b54d1, cookie 0xf7de4ef628ee101a 00000020:00000080:0.0:1783135743.501978:0:17065:0:(genops.c:1406:class_connect()) connect: client 06406641-6839-4a1a-8419-9f7c420b54d1, cookie 0xf7de4ef628ee1013 00000004:00100000:0.0:1783135743.502194:0:17065:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:3.0:1783135743.502227:0:17772:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783135743.502432:0:17065:0:(import.c:65:import_set_state_nolock()) ffff8ac5441e4000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1783135743.503522:0:17772:0:(import.c:65:import_set_state_nolock()) ffff8ac54257b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135743.503703:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06406641-6839-4a1a-8419-9f7c420b54d1+6:2397:x1869752786086656:12345-192.168.204.6@tcp:38:mount.lustre.0 Request processed in 1759us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135743.503723:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:1.0:1783135743.505193:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+6:2397:x1869752786086400:12345-192.168.204.6@tcp:38:mount.lustre.0 Request processed in 3305us (4114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135743.505207:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:3.0:1783135743.508628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135743.508743:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786086784 00000100:00100000:2.0:1783135743.508755:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786086784 00000100:00100000:2.0:1783135743.508842:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:2.0:1783135743.508853:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06406641-6839-4a1a-8419-9f7c420b54d1+6:0:x1869752786086784:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783135743.508910:0:17064:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1783135743.508933:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783135743.508979:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06406641-6839-4a1a-8419-9f7c420b54d1+6:0:x1869752786086784:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 129us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135743.508985:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:3.0:1783135743.521216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135743.521253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135743.521339:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786086528 00000100:00100000:0.0:1783135743.521349:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786086528 00000100:00100000:1.0:1783135743.521382:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786086912 00000100:00100000:1.0:1783135743.521388:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786086912 00000100:00100000:0.0:1783135743.521419:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00080000:3.0:1783135743.521450:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135743.521480:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06406641-6839-4a1a-8419-9f7c420b54d1+7:0:x1869752786086528:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783135743.521517:0:17772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783135743.521648:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06406641-6839-4a1a-8419-9f7c420b54d1+7:0:x1869752786086528:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 171us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135743.521703:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:1.0:1783135743.521716:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:1.0:1783135743.521728:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+6:15032:x1869752786086912:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135743.521745:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1783135743.521787:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+6:15032:x1869752786086912:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 62us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135743.522589:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:3.0:1783135743.530166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135743.530446:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786087040 00000100:00100000:2.0:1783135743.530457:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786087040 00000100:00100000:2.0:1783135743.530931:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:2.0:1783135743.530945:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06406641-6839-4a1a-8419-9f7c420b54d1+6:15032:x1869752786087040:12345-192.168.204.6@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783135743.531041:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06406641-6839-4a1a-8419-9f7c420b54d1+6:15032:x1869752786087040:12345-192.168.204.6@tcp:40:mount.lustre.0 Request processed in 95us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135743.531049:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:3.0:1783135743.537982:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135743.538023:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135743.538070:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135743.538136:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786087168 00000100:00100000:0.0:1783135743.538147:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786087168 00000100:00100000:0.0:1783135743.538190:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786087296 00000100:00100000:0.0:1783135743.538193:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786087296 00000100:00100000:3.0:1783135743.538222:0:19680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:3.0:1783135743.538230:0:19680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1869752786087168:12345-192.168.204.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783135743.538262:0:19680:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 06406641-6839-4a1a-8419-9f7c420b54d1@192.168.204.6@tcp t0 exp 0000000000000000 cur 647 last 0 00000100:00100000:2.0:1783135743.538263:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786087424 00000100:00100000:2.0:1783135743.538269:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786087424 00000020:00000080:3.0:1783135743.538293:0:19680:0:(genops.c:1406:class_connect()) connect: client 06406641-6839-4a1a-8419-9f7c420b54d1, cookie 0xf7de4ef628ee1021 00002000:00100000:3.0:1783135743.538307:0:19680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 06406641-6839-4a1a-8419-9f7c420b54d1/ffff8ac54257c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1783135743.538315:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00002000:00100000:3.0:1783135743.538319:0:19680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783135743.538325:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:06406641-6839-4a1a-8419-9f7c420b54d1+6:15032:x1869752786087424:12345-192.168.204.6@tcp:900:mount.lustre.0 00002000:00080000:3.0:1783135743.538399:0:19680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1783135743.538408:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:06406641-6839-4a1a-8419-9f7c420b54d1+6:15032:x1869752786087424:12345-192.168.204.6@tcp:900:mount.lustre.0 Request processed in 83us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135743.538417:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00080000:3.0:1783135743.538422:0:19680:0:(import.c:65:import_set_state_nolock()) ffff8ac54257b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135743.538449:0:19680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06406641-6839-4a1a-8419-9f7c420b54d1+6:2397:x1869752786087168:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 219us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135743.538455:0:19680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:3.0:1783135743.538469:0:19680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:3.0:1783135743.538474:0:19680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1869752786087296:12345-192.168.204.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783135743.538490:0:19680:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 06406641-6839-4a1a-8419-9f7c420b54d1@192.168.204.6@tcp t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:3.0:1783135743.538512:0:19680:0:(genops.c:1406:class_connect()) connect: client 06406641-6839-4a1a-8419-9f7c420b54d1, cookie 0xf7de4ef628ee1028 00002000:00100000:3.0:1783135743.538518:0:19680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 06406641-6839-4a1a-8419-9f7c420b54d1/ffff8ac543692000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783135743.538524:0:19680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783135743.538580:0:19680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783135743.538594:0:19680:0:(import.c:65:import_set_state_nolock()) ffff8ac543697000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135743.538642:0:19680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:06406641-6839-4a1a-8419-9f7c420b54d1+6:2397:x1869752786087296:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 165us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135743.538653:0:19680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:2.0:1783135743.554247:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135743.555045:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786087552 00000100:00100000:3.0:1783135743.555058:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786087552 00000100:00100000:3.0:1783135743.555176:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:3.0:1783135743.555188:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06406641-6839-4a1a-8419-9f7c420b54d1+6:15032:x1869752786087552:12345-192.168.204.6@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783135743.555290:0:17068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783135743.555388:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06406641-6839-4a1a-8419-9f7c420b54d1+6:15032:x1869752786087552:12345-192.168.204.6@tcp:33:mount.lustre.0 Request processed in 201us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135743.555397:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00000040:00080000:0.0:1783135743.726877:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783135743.793488:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135743.793788:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786087680 00000100:00100000:3.0:1783135743.793797:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786087680 00000100:00100000:3.0:1783135743.793874:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:3.0:1783135743.793889:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+6:15066:x1869752786087680:12345-192.168.204.6@tcp:101:mkdir.0 00010000:00010000:3.0:1783135743.793912:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135743.794042:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527c00/0xf7de4ef628ee102f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410b8 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135743.794132:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135743.794152:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135743.794163:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135743.794284:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783135743.794288:0:17066:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135743.794304:0:17066:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135743.794324:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527c00/0xf7de4ef628ee102f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410b8 expref: 8 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135743.794338:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410b8 expref: 7 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135743.794344:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6508cf200) 00010000:00010000:3.0:1783135743.794347:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135743.794349:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526a00, rc 0) 00000100:00100000:3.0:1783135743.794450:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+7:15066:x1869752786087680:12345-192.168.204.6@tcp:101:mkdir.0 Request processed in 566us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135743.794457:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:2.0:1783135743.855024:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135743.857261:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809240064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783135743.858356:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135743.858954:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809240064 00000100:00100000:3.0:1783135743.858966:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809240064 00000100:00100000:3.0:1783135743.859042:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783135743.859054:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809240064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135743.859135:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135743.859218:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809240064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135743.859226:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783135743.859516:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809240064:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783135744.366539:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135744.366985:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135744.368113:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809240192:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783135744.368192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135744.374946:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809240192 00000100:00100000:3.0:1783135744.374965:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809240192 00000100:00100000:3.0:1783135744.375074:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783135744.375084:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809240192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135744.375143:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135744.375241:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809240192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 159us (7049us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135744.375249:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783135744.375991:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809240192:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135745.390307:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783135745.908811:0:18569:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 06406641-6839-4a1a-8419-9f7c420b54d1 00000001:00100000:1.0:1783135745.908846:0:18569:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 07e1865a-1721-4bc6-87c1-03d8d78664fd 00010000:00010000:1.0:1783135746.414768:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783135746.416805:0:17044:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 06406641-6839-4a1a-8419-9f7c420b54d1 00000001:00100000:0.0:1783135746.416819:0:17044:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 07e1865a-1721-4bc6-87c1-03d8d78664fd 00000001:00100000:2.0:1783135746.426675:0:17798:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 06406641-6839-4a1a-8419-9f7c420b54d1 00000001:00100000:2.0:1783135746.426690:0:17798:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 07e1865a-1721-4bc6-87c1-03d8d78664fd 00000001:02000400:0.0:1783135746.591674:0:19946:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1783135747.438458:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809240320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135747.438571:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135747.438684:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809240320 00000100:00100000:0.0:1783135747.438692:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809240320 00000100:00100000:0.0:1783135747.438754:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783135747.438764:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809240320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135747.438794:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783135747.438858:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809240320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135747.438866:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783135747.438906:0:3648:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1783135747.438927:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809240320:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783135747.439003:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135747.439300:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135747.439312:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809240448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135747.439355:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135747.439381:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809240448 00000100:00100000:3.0:1783135747.439385:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809240448 00000100:00100000:3.0:1783135747.439414:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135747.439422:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809240448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135747.439442:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1783135747.439473:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809240448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135747.439479:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135747.439509:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac541d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809240448:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783135747.439580:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135747.439707:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809240832:0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.439736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135747.439752:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809241344:0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.439770:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135747.439790:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809241856:0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.439810:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135747.439827:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783135747.439832:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809240960:0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.439870:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135747.439889:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809241472:0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.439908:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135747.439930:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809240832 00000100:00100000:1.0:1783135747.439940:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809240832 00000100:00100000:1.0:1783135747.439966:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809241344 00000100:00100000:1.0:1783135747.439969:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809241344 00000100:00100000:1.0:1783135747.439978:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809241856 00000100:00100000:1.0:1783135747.439980:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809241856 00000100:00100000:1.0:1783135747.440011:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809241472 00000100:00100000:1.0:1783135747.440017:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809241472 00000100:00100000:1.0:1783135747.440030:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783135747.440036:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809240832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.440244:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809240832:12345-0@lo:400:kworker.0 Request processed in 48us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135747.440253:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783135747.440266:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783135747.440273:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809241344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.440299:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809241344:12345-0@lo:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135747.440305:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783135747.440314:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135747.440320:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809241856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.440343:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809241856:12345-0@lo:400:kworker.0 Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135747.440349:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135747.440359:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135747.440364:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809241472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.440389:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1869752809241472:12345-0@lo:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135747.440395:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135747.440411:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809240960 00000100:00100000:1.0:1783135747.440414:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809240960 00000100:00100000:1.0:1783135747.440435:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783135747.440440:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809240960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.440466:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809240960:12345-0@lo:400:kworker.0 Request processed in 26us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135747.440471:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1783135747.440489:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135747.440492:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135747.440509:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809240960:0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.440518:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1869752809241472:0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.440526:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544174380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809240832:0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.440546:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809241344:0@lo:400:kworker.0 00010000:00080000:1.0:1783135747.440559:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac5441bce00 x1869752809241856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135747.440569:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809241856:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.440724:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809240576:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.440753:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135747.440784:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809241088:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.440807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135747.440821:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809241600:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.440839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135747.440875:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783135747.440887:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac544177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809240704:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.440907:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135747.440920:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809241216:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.440936:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135747.440947:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809241728:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.440963:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135747.440981:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809241600 00000100:00100000:3.0:1783135747.440984:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809241600 00000100:00100000:3.0:1783135747.441023:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809241728 00000100:00100000:3.0:1783135747.441025:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809241728 00000100:00100000:3.0:1783135747.441037:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783135747.441043:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809241600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.441075:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809241600:12345-0@lo:400:kworker.0 Request processed in 32us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135747.441080:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783135747.441254:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783135747.441261:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809241728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.441289:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1869752809241728:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135747.441294:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783135747.441311:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809240704 00000100:00100000:3.0:1783135747.441314:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809240704 00000100:00100000:3.0:1783135747.441336:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783135747.441342:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809240704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.441370:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809240704:12345-0@lo:400:kworker.0 Request processed in 28us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135747.441375:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1783135747.441398:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135747.441401:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135747.441423:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544177100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809240704:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.441433:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1869752809241728:0@lo:400:kworker.0 00010000:00080000:3.0:1783135747.441441:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67b3b0380 x1869752809241600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135747.441450:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809241600:0@lo:400:kworker.0 00000100:00100000:2.0:1783135747.441552:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809241984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135747.441585:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135747.441623:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135747.441695:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809241088 00000100:00100000:1.0:1783135747.441699:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809241088 00000100:00100000:1.0:1783135747.441737:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809241216 00000100:00100000:1.0:1783135747.441739:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809241216 00000100:00100000:1.0:1783135747.441755:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135747.441761:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809241088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.441807:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809241088:12345-0@lo:400:kworker.0 Request processed in 46us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135747.441814:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135747.441824:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135747.441830:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809241216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135747.441851:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809241216:12345-0@lo:400:kworker.0 Request processed in 22us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135747.441856:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135747.441928:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809241216:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.441937:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809241088:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.441954:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809241984 00000100:00100000:3.0:1783135747.441957:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809241984 00000100:00100000:3.0:1783135747.441985:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783135747.442120:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809240576 00000100:00100000:0.0:1783135747.442124:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809240576 00000100:00100000:0.0:1783135747.442151:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783135747.442157:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3646:x1869752809240576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135747.442193:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3646:x1869752809240576:12345-0@lo:400:kworker.0 Request processed in 37us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135747.442199:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783135747.442241:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac544175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809240576:0@lo:400:kworker.0 00000100:00100000:3.0:1783135747.442360:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809241984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783135747.442377:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783135747.442425:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809241984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 434us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135747.442432:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1783135747.442497:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135747.442501:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135747.442610:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809241984:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1783135748.462240:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135748.462502:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135748.462540:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809242112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135748.462627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135748.462796:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809242112 00000100:00100000:2.0:1783135748.462804:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809242112 00000100:00100000:2.0:1783135748.462865:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135748.462875:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809242112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135748.462899:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783135748.462955:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809242112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135748.462963:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783135748.463065:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809242112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135748.664478:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135748.664529:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135748.664566:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135748.664588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135748.664607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135748.664627:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135748.664645:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135748.664663:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135748.664686:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135748.664710:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786087808 00000100:00100000:2.0:1783135748.664722:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786087808 00000100:00100000:2.0:1783135748.664778:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 148 00000100:00100000:2.0:1783135748.664789:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+13:2399:x1869752786087808:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135748.664866:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c513450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+13:2399:x1869752786087808:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 78us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135748.664874:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 148 00000100:00100000:2.0:1783135748.664906:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786088064 00000100:00100000:2.0:1783135748.664910:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786088064 00000100:00100000:2.0:1783135748.664955:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786088576 00000100:00100000:2.0:1783135748.664959:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786088576 00000100:00100000:2.0:1783135748.664972:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786087936 00000100:00100000:2.0:1783135748.664975:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786087936 00000100:00100000:2.0:1783135748.664987:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786088448 00000100:00100000:2.0:1783135748.664990:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786088448 00000100:00100000:2.0:1783135748.665004:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:2.0:1783135748.665011:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786088064:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135748.665041:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786088064:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135748.665049:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:2.0:1783135748.665060:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:2.0:1783135748.665066:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+5:2399:x1869752786088576:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135748.665113:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+5:2399:x1869752786088576:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 47us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135748.665120:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:2.0:1783135748.665131:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:2.0:1783135748.665137:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:2399:x1869752786087936:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135748.665162:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:2399:x1869752786087936:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135748.665176:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:2.0:1783135748.665188:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:2.0:1783135748.665194:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+6:2399:x1869752786088448:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135748.665217:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+6:2399:x1869752786088448:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135748.665223:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:2.0:1783135748.665242:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786088320 00000100:00100000:2.0:1783135748.665246:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786088320 00000100:00100000:2.0:1783135748.665273:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786088832 00000100:00100000:2.0:1783135748.665276:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786088832 00000100:00100000:2.0:1783135748.665288:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786088192 00000100:00100000:2.0:1783135748.665291:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786088192 00000100:00100000:2.0:1783135748.665301:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786088704 00000100:00100000:2.0:1783135748.665303:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786088704 00000100:00100000:2.0:1783135748.665316:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:2.0:1783135748.665817:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786088320:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135748.665849:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786088320:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 527us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135748.665857:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:2.0:1783135748.665872:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:2.0:1783135748.665878:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06406641-6839-4a1a-8419-9f7c420b54d1+6:2399:x1869752786088832:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135748.665898:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06406641-6839-4a1a-8419-9f7c420b54d1+6:2399:x1869752786088832:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 21us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135748.665904:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:2.0:1783135748.665914:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:2.0:1783135748.665977:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786088192:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135748.666015:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786088192:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 90us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135748.666022:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:2.0:1783135748.666034:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:2.0:1783135748.666040:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06406641-6839-4a1a-8419-9f7c420b54d1+5:2399:x1869752786088704:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135748.666059:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:06406641-6839-4a1a-8419-9f7c420b54d1+5:2399:x1869752786088704:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 20us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135748.666065:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00080000:2.0:1783135748.666853:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135748.666860:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135748.666863:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135748.666866:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135748.980379:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135748.980415:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809242240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783135748.980483:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135748.980541:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809242240 00000100:00100000:3.0:1783135748.980549:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809242240 00000100:00100000:3.0:1783135748.980593:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783135748.980600:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809242240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783135748.980632:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1783135748.981195:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809242240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 592us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135748.981203:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783135748.981261:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809242240:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1783135748.993084:0:19388:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 06406641-6839-4a1a-8419-9f7c420b54d1 00000100:00100000:2.0:1783135749.486905:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783135749.488947:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135749.493002:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809242368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135749.493993:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135749.494128:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809242368 00000100:00100000:0.0:1783135749.494142:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809242368 00000100:00100000:0.0:1783135749.494199:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783135749.494209:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809242368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783135749.494247:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783135749.494315:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809242368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135749.494322:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135749.494802:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809242368:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1783135750.257797:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783135750.511384:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783135750.568832:0:20094:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc635b7f00 20000000:00000080:2.0:1783135750.568852:0:20094:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ac675962400 uarg=0000000000000000 20000000:01000000:2.0:1783135750.568897:0:20094:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783135750.568903:0:20094:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783135750.568908:0:20094:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783135750.570658:0:20095:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1783135750.570819:0:20094:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1783135750.586013:0:20094:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783135750.586805:0:20094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.586824:0:20094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67e20fc00/0xf7de4ef628ee0cd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0ccb expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.586831:0:20094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628ee0ce0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0cd9 expref: 23 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.586837:0:20094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67e64a000/0xf7de4ef628ee0d1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0d18 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.586843:0:20094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628ee0e7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee0e76 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.586851:0:20094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67e20f800/0xf7de4ef628ee0fcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141017 expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.586858:0:20094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ac67c65c600/0xf7de4ef628ee100c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141087 expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.586865:0:20094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.586905:0:20094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67c65c600/0xf7de4ef628ee100c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141087 expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.586931:0:20094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67c65c600/0xf7de4ef628ee100c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141087 expref: 12 pid: 17058 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135750.586946:0:20094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809242496:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135750.587279:0:20094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67e20f800/0xf7de4ef628ee0fcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141017 expref: 12 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.587289:0:20094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67e20f800/0xf7de4ef628ee0fcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141017 expref: 12 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135750.587297:0:20094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a76d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809242624:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135750.587328:0:20094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628ee0e7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0e76 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.587335:0:20094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628ee0e7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0e76 expref: 23 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135750.587342:0:20094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809242752:0@lo:104: 00000100:00100000:3.0:1783135750.587381:0:20094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135750.587411:0:20094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67e64a000/0xf7de4ef628ee0d1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0d18 expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.587419:0:20094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67e64a000/0xf7de4ef628ee0d1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d18 expref: 23 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135750.587426:0:20094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a75c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809242880:0@lo:104: 00000100:00100000:3.0:1783135750.587446:0:20094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135750.587501:0:20094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628ee0ce0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0cd9 expref: 23 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135750.587615:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809242752 00000100:00100000:0.0:1783135750.587626:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809242752 00000100:00100000:0.0:1783135750.587664:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809242880 00000100:00100000:0.0:1783135750.587667:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809242880 00000100:00100000:0.0:1783135750.587679:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135750.587687:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:20094:x1869752809242752:12345-0@lo:104: 00010000:00010000:0.0:1783135750.587698:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.587745:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135750.587750:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:20094:x1869752809242752:12345-0@lo:104: Request processed in 65us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135750.587757:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135750.587772:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135750.587778:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:20094:x1869752809242880:12345-0@lo:104: 00010000:00010000:0.0:1783135750.587785:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.587813:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783135750.587818:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:20094:x1869752809242880:12345-0@lo:104: Request processed in 41us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135750.587824:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1783135750.587840:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135750.587846:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.587853:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526400 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135750.587857:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.587876:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135750.587884:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135750.587889:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783135750.587917:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.587924:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135750.587940:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.587947:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c526400/0xf7de4ef628ee0e76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0e7d expref: -99 pid: 19387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.587957:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135750.587960:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.587965:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527000 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135750.587968:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.587975:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135750.587981:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135750.587991:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783135750.588005:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.588011:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135750.588025:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.588042:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67c527000/0xf7de4ef628ee0d18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0d1f expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.588052:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135750.588061:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135750.588063:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135750.588069:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135750.588082:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135750.588116:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809243136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135750.588144:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135750.588176:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809243264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135750.588198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135750.589810:0:20094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628ee0ce0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0cd9 expref: 23 pid: 17059 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135750.589840:0:20094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809243008:0@lo:104: 00000100:00100000:3.0:1783135750.589895:0:20094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135750.589957:0:20094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ac67e20fc00/0xf7de4ef628ee0cd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf7de4ef628ee0ccb expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.589968:0:20094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ac67e20fc00/0xf7de4ef628ee0cd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf7de4ef628ee0ccb expref: 23 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135750.589977:0:20094:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809243392:0@lo:104: 00000100:00100000:3.0:1783135750.589998:0:20094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135750.590008:0:20094:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6753426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135750.590178:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809243008 00000100:00100000:0.0:1783135750.590184:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809243008 00000100:00100000:0.0:1783135750.590218:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809243392 00000100:00100000:0.0:1783135750.590221:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809243392 00000100:00100000:0.0:1783135750.590234:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135750.590241:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:20094:x1869752809243008:12345-0@lo:104: 00010000:00010000:0.0:1783135750.590254:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590317:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135750.590322:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+4:20094:x1869752809243008:12345-0@lo:104: Request processed in 81us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135750.590329:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135750.590345:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135750.590351:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:20094:x1869752809243392:12345-0@lo:104: 00010000:00010000:0.0:1783135750.590359:0:17047:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590391:0:17047:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783135750.590395:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+3:20094:x1869752809243392:12345-0@lo:104: Request processed in 45us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135750.590401:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1783135750.590417:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135750.590422:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590428:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908000 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135750.590431:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590439:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135750.590446:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135750.590452:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783135750.590502:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590517:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135750.590534:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590540:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67f908000/0xf7de4ef628ee0cd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0ce0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590553:0:17052:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135750.590556:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590562:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64a400 already unused, calling callback (ffffffffc12dac20) 10000000:00010000:0.0:1783135750.590565:0:17052:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590571:0:17052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135750.590576:0:17052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135750.590581:0:17052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783135750.590593:0:17052:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590598:0:17052:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135750.590610:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590627:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8ac67e64a400/0xf7de4ef628ee0ccb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf7de4ef628ee0cd2 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590640:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135750.590642:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135750.590643:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135750.590660:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135750.590671:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809243520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135750.590698:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135750.590722:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809243648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135750.590743:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135750.590769:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809243136 00000100:00100000:0.0:1783135750.590773:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809243136 00010000:00010000:0.0:1783135750.590791:0:18599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628ee0e7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0e76 expref: 24 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135750.590859:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809243264 00000100:00100000:0.0:1783135750.590862:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809243264 00010000:00010000:0.0:1783135750.590873:0:18599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67e64a000/0xf7de4ef628ee0d1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d18 expref: 25 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135750.590882:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809243520 00000100:00100000:0.0:1783135750.590884:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809243520 00010000:00010000:0.0:1783135750.590892:0:18599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628ee0ce0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0cd9 expref: 26 pid: 17059 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135750.590902:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809243648 00000100:00100000:0.0:1783135750.590903:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809243648 00010000:00010000:0.0:1783135750.590912:0:18599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67e20fc00/0xf7de4ef628ee0cd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0ccb expref: 27 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135750.590931:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135750.590937:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+27:3648:x1869752809243136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135750.590947:0:18599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135750.590954:0:18599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628ee0e7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0e76 expref: 27 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590962:0:18599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628ee0e7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0e76 expref: 27 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.590977:0:18599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135750.591006:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+27:3648:x1869752809243136:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135750.591012:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135750.591025:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135750.591045:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543794380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+26:3646:x1869752809243264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135750.591060:0:18599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135750.591065:0:18599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67e64a000/0xf7de4ef628ee0d1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d18 expref: 26 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.591073:0:18599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67e64a000/0xf7de4ef628ee0d1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0d18 expref: 26 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.591082:0:18599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135750.591129:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543794380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+26:3646:x1869752809243264:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135750.591135:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135750.591147:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135750.591159:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+25:3646:x1869752809243520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135750.591167:0:18599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135750.591171:0:18599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628ee0ce0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0cd9 expref: 25 pid: 17059 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.591178:0:18599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628ee0ce0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0cd9 expref: 25 pid: 17059 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.591187:0:18599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135750.591209:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+25:3646:x1869752809243520:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135750.591215:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135750.591227:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135750.591232:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3648:x1869752809243648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135750.591239:0:18599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135750.591243:0:18599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67e20fc00/0xf7de4ef628ee0cd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf7de4ef628ee0ccb expref: 24 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.591250:0:18599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67e20fc00/0xf7de4ef628ee0cd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf7de4ef628ee0ccb expref: 24 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.591258:0:18599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135750.591277:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3648:x1869752809243648:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135750.591283:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135750.591309:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809243520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135750.591317:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809243264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135750.591342:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809243648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135750.591359:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809243136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135750.591579:0:20094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac6413e9200/0xf7de4ef628ee0e7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0e76 expref: 23 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135750.591594:0:20094:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809242752:0@lo:104: 00010000:00010000:3.0:1783135750.591609:0:20094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e64a000/0xf7de4ef628ee0d1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0d18 expref: 22 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135750.591616:0:20094:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a75c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809242880:0@lo:104: 00010000:00010000:3.0:1783135750.591623:0:20094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20fe00/0xf7de4ef628ee0ce0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0cd9 expref: 21 pid: 17059 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135750.591630:0:20094:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809243008:0@lo:104: 00010000:00010000:3.0:1783135750.591637:0:20094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20fc00/0xf7de4ef628ee0cd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf7de4ef628ee0ccb expref: 20 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135750.591651:0:20094:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809243392:0@lo:104: 00010000:00010000:2.0:1783135750.593216:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135750.597745:0:20094:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809242496:192.168.204.6@tcp:104: 00000100:00100000:3.0:1783135750.597767:0:20094:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a76d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20094:1869752809242624:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135750.597819:0:20094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135750.601863:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135750.601996:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786089088 00000100:00100000:0.0:1783135750.602008:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786089088 00010000:00010000:0.0:1783135750.602064:0:18599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67e20f800/0xf7de4ef628ee0fcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141017 expref: 13 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135750.602147:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:0.0:1783135750.602157:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:455f3cf7-16ee-408c-8389-ea23e4967612+13:2400:x1869752786089088:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135750.602173:0:18599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135750.602179:0:18599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67e20f800/0xf7de4ef628ee0fcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141017 expref: 13 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.602192:0:18599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67e20f800/0xf7de4ef628ee0fcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141017 expref: 13 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.602211:0:18599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67e20f800/0xf7de4ef628ee0fcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141017 expref: 13 pid: 17056 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.602227:0:18599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135750.602277:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:455f3cf7-16ee-408c-8389-ea23e4967612+12:2400:x1869752786089088:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 121us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135750.602285:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:2.0:1783135750.604830:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135750.604932:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786088960 00000100:00100000:0.0:1783135750.604941:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786088960 00010000:00010000:0.0:1783135750.604971:0:17051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ac67c65c600/0xf7de4ef628ee100c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141087 expref: 12 pid: 17058 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135750.605007:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:0.0:1783135750.605028:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:455f3cf7-16ee-408c-8389-ea23e4967612+12:2400:x1869752786088960:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135750.605051:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135750.605063:0:17051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ac67c65c600/0xf7de4ef628ee100c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141087 expref: 12 pid: 17058 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605078:0:17051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ac67c65c600/0xf7de4ef628ee100c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141087 expref: 12 pid: 17058 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605120:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c65c600/0xf7de4ef628ee100c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141087 expref: 12 pid: 17058 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605137:0:17051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605145:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605159:0:17051:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605166:0:17051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605172:0:17051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605178:0:17051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605183:0:17051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527400 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135750.605187:0:17051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605200:0:17051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605220:0:17051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135750.605230:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135750.605276:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:455f3cf7-16ee-408c-8389-ea23e4967612+11:2400:x1869752786088960:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 249us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135750.605283:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00010000:00010000:3.0:1783135750.605390:0:20094:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.605408:0:20094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135750.605415:0:20094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee103d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135751.542436:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135751.802760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135751.802915:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786089216 00000100:00100000:3.0:1783135751.802931:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786089216 00000100:00100000:3.0:1783135751.803009:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 149 00000100:00100000:3.0:1783135751.803022:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+11:14916:x1869752786089216:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135751.803046:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135751.803076:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527c00/0xf7de4ef628ee1044 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410bf expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135751.803156:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527c00/0xf7de4ef628ee1044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410bf expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135751.803170:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527c00/0xf7de4ef628ee1044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410bf expref: 12 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135751.803193:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527c00, rc 0) 00000100:00100000:3.0:1783135751.803263:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c510c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+12:14916:x1869752786089216:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 244us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135751.803271:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 149 00000100:00100000:2.0:1783135751.807041:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135751.807247:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786089344 00000100:00100000:0.0:1783135751.807260:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786089344 00000100:00100000:0.0:1783135751.807403:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 150 00000100:00100000:0.0:1783135751.807419:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+12:14916:x1869752786089344:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135751.808515:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c513850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+12:14916:x1869752786089344:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 1095us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135751.808530:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 150 00000100:00100000:0.0:1783135751.814451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135751.814781:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786089472 00000100:00100000:2.0:1783135751.814795:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786089472 00000100:00100000:2.0:1783135751.814869:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 151 00000100:00100000:2.0:1783135751.814881:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+12:14916:x1869752786089472:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135751.815075:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+12:14916:x1869752786089472:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 195us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135751.815100:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 151 00000100:00100000:2.0:1783135751.826470:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135751.827080:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786089600 00000100:00100000:3.0:1783135751.827128:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786089600 00000100:00100000:3.0:1783135751.827218:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 152 00000100:00100000:3.0:1783135751.827230:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+12:14916:x1869752786089600:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135751.827257:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135751.827283:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee104b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410c6 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135751.827324:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee104b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410c6 expref: 13 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135751.827349:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c527400/0xf7de4ef628ee104b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410c6 expref: 13 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135751.827361:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527400, rc 0) 00000100:00100000:3.0:1783135751.827460:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c510450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:455f3cf7-16ee-408c-8389-ea23e4967612+13:14916:x1869752786089600:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 223us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135751.827469:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 152 00000100:00100000:2.0:1783135751.837111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135751.837511:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786089728 00000100:00100000:0.0:1783135751.837530:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786089728 00000100:00100000:0.0:1783135751.837610:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 153 00000100:00100000:0.0:1783135751.837784:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+13:14916:x1869752786089728:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135751.838016:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+13:14916:x1869752786089728:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 393us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135751.838035:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 153 00000100:00100000:1.0:1783135751.842004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135751.842696:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786089856 00000100:00100000:2.0:1783135751.842715:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786089856 00000100:00100000:2.0:1783135751.842843:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 154 00000100:00100000:2.0:1783135751.842857:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+13:14916:x1869752786089856:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135751.843082:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+13:14916:x1869752786089856:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 227us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135751.843128:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 154 00000100:00100000:2.0:1783135752.562190:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809244160:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562273:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562319:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809244672:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562342:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562359:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809245184:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562387:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562426:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1783135752.562432:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809243776:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562511:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809244288:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562530:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562545:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809244800:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562578:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809245312:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562599:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562624:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809243904:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562650:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562667:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809244416:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562685:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562701:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809244928:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562752:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1783135752.562758:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809244032:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562854:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562873:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809244544:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562897:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562912:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809245056:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.562935:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.562968:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809244160 00000100:00100000:2.0:1783135752.562977:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809244160 00000100:00100000:2.0:1783135752.563031:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809244672 00000100:00100000:2.0:1783135752.563040:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809244672 00000100:00100000:2.0:1783135752.563060:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809244032 00000100:00100000:2.0:1783135752.563063:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809244032 00000100:00100000:2.0:1783135752.563076:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809244544 00000100:00100000:2.0:1783135752.563078:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809244544 00000100:00100000:2.0:1783135752.563120:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135752.563129:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809244160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.563187:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809244160:12345-0@lo:400:kworker.0 Request processed in 59us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135752.563195:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135752.563211:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135752.563218:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809244672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.563244:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809244672:12345-0@lo:400:kworker.0 Request processed in 27us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135752.563250:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135752.563261:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135752.563268:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809244032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.563296:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809244032:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135752.563302:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135752.563311:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135752.563317:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809244544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.563342:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809244544:12345-0@lo:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135752.563348:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135752.563369:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809245184 00000100:00100000:2.0:1783135752.563373:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809245184 00000100:00100000:2.0:1783135752.563400:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809244288 00000100:00100000:2.0:1783135752.563403:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809244288 00000100:00100000:2.0:1783135752.563413:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809244800 00000100:00100000:2.0:1783135752.563415:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809244800 00000100:00100000:2.0:1783135752.563424:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809245312 00000100:00100000:2.0:1783135752.563426:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809245312 00000100:00100000:2.0:1783135752.563436:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809244928 00000100:00100000:2.0:1783135752.563451:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809244928 00000100:00100000:2.0:1783135752.563466:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809245056 00000100:00100000:2.0:1783135752.563468:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809245056 00000100:00100000:1.0:1783135752.566851:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809243904 00000100:00100000:1.0:1783135752.566868:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809243904 00000100:00100000:1.0:1783135752.566927:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809244416 00000100:00100000:1.0:1783135752.566931:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809244416 00000100:00100000:1.0:1783135752.566951:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135752.566963:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809243904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567067:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809243904:12345-0@lo:400:kworker.0 Request processed in 107us (4415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.567074:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135752.567114:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783135752.567121:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809244416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567151:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809244416:12345-0@lo:400:kworker.0 Request processed in 30us (4464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.567156:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783135752.567180:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783135752.567188:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809245184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567219:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809245184:12345-0@lo:400:kworker.0 Request processed in 33us (4831us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.567224:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783135752.567240:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783135752.567245:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809244288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567272:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809244288:12345-0@lo:400:kworker.0 Request processed in 27us (4741us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.567291:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783135752.567304:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783135752.567310:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809244800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567341:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809244800:12345-0@lo:400:kworker.0 Request processed in 32us (4777us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.567347:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783135752.567359:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783135752.567365:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809245312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567392:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809245312:12345-0@lo:400:kworker.0 Request processed in 28us (4792us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.567398:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783135752.567412:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135752.567418:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809244928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567458:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809244928:12345-0@lo:400:kworker.0 Request processed in 40us (4717us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.567463:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135752.567499:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809243776 00000100:00100000:1.0:1783135752.567513:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809243776 00000100:00100000:1.0:1783135752.567540:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783135752.567545:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:3648:x1869752809243776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567571:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c513050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:3648:x1869752809243776:12345-0@lo:400:kworker.0 Request processed in 26us (5099us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.567576:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1783135752.567625:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135752.567630:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135752.567640:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135752.567643:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135752.567698:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809244032:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567711:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809244544:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567721:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809243904:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567731:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809244416:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567740:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809244928:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567775:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3648:1869752809243776:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567785:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809244288:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567794:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809244800:0@lo:400:kworker.0 00010000:00080000:1.0:1783135752.567806:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67e2a0e00 x1869752809245312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135752.567817:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809245312:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567828:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809244160:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567839:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809244672:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.567853:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809245184:0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.568128:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783135752.568136:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809245056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135752.568174:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809245056:12345-0@lo:400:kworker.0 Request processed in 39us (5238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135752.568180:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 10000000:01000000:0.0:1783135752.568637:0:17061:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135752.568641:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac66fada000 from 13 10000000:01000000:0.0:1783135752.568645:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135752.568671:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b000/0xf7de4ef628ee1052 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135752.568681:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b000/0xf7de4ef628ee1052 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135752.568692:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b000/0xf7de4ef628ee1052 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135752.568711:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809245568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135752.568751:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135752.568778:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54308a240 going to sleep for 11 seconds 00010000:00010000:0.0:1783135752.568790:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135752.569360:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783135752.569383:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809245440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135752.569415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783135752.569469:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac67e2a0380 x1869752809245056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135752.569493:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809245056:0@lo:400:kworker.0 00000100:00100000:1.0:1783135752.569525:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809245440 00000100:00100000:1.0:1783135752.569530:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809245440 00000100:00100000:1.0:1783135752.569563:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135752.569571:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809245440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135752.569596:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783135752.569635:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809245440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.569642:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135752.569676:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809245440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135752.570635:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809245568 00000100:00100000:2.0:1783135752.570641:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809245568 00000100:00100000:2.0:1783135752.570672:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783135752.570681:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+20:17061:x1869752809245568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135752.570692:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135752.570707:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628ee1059 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee1052 expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.570729:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628ee1059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee1052 expref: 21 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.570740:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65d200/0xf7de4ef628ee1059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee1052 expref: 21 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.570750:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d200, rc 0) 00000100:00100000:2.0:1783135752.570806:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:17061:x1869752809245568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135752.570812:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783135752.570853:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809245568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135752.570870:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b000/0xf7de4ef628ee1052 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1059 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.570880:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b000/0xf7de4ef628ee1052 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee1059 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135752.570954:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809245824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135752.570984:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.571009:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439873c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135752.571023:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809245696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783135752.571048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135752.572607:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809245824 00000100:00100000:1.0:1783135752.572619:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809245824 00000100:00100000:1.0:1783135752.572669:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783135752.572677:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:17061:x1869752809245824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135752.572823:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c511c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:17061:x1869752809245824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.572835:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783135752.572866:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809245696 00000100:00100000:1.0:1783135752.572870:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809245696 00000100:00100000:1.0:1783135752.572892:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135752.572898:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809245696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783135752.572911:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783135752.572943:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809245952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135752.572958:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809245696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.572982:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135752.573013:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809245824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135752.573043:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135752.573046:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135752.573082:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135752.573118:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809246080 00000100:00100000:1.0:1783135752.573120:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67838b840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135752.573126:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809246080 00000100:00100000:1.0:1783135752.573132:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809245952 00000100:00100000:1.0:1783135752.573134:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809245952 00000100:00100000:3.0:1783135752.573149:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783135752.573149:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135752.573154:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809245952:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135752.573155:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:17061:x1869752809246080:12345-0@lo:503:ll_cfg_requeue.0 00002000:00000024:1.0:1783135752.573171:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1783135752.573202:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809245952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.573208:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135752.573329:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809245952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135752.573348:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:17061:x1869752809246080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.573350:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135752.573355:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783135752.575120:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809245696:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1783135752.576821:0:20161:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783135752.578681:0:17061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783135752.578727:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135752.578740:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b000/0xf7de4ef628ee1052 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1059 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135752.578752:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e64b000/0xf7de4ef628ee1052 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1059 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135752.578763:0:17061:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135752.578765:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac642c1d000 from 13 10000000:01000000:1.0:1783135752.578781:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135752.578823:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f200/0xf7de4ef628ee1060 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135752.578832:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f200/0xf7de4ef628ee1060 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135752.578843:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f200/0xf7de4ef628ee1060 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135752.578870:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135752.578952:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135752.579008:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac67838b840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135752.579160:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809246208 00000100:00100000:2.0:1783135752.579169:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809246208 00000100:00100000:2.0:1783135752.579217:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783135752.579226:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+21:17061:x1869752809246208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135752.579239:0:17058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135752.579251:0:17058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c65d000/0xf7de4ef628ee1067 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee1060 expref: -99 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.579274:0:17058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c65d000/0xf7de4ef628ee1067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee1060 expref: 22 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.579296:0:17058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c65d000/0xf7de4ef628ee1067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee1060 expref: 22 pid: 17058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.579306:0:17058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d000, rc 0) 00000100:00100000:2.0:1783135752.579355:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:17061:x1869752809246208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135752.579362:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783135752.580408:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135752.580428:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f200/0xf7de4ef628ee1060 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1067 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135752.580437:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f200/0xf7de4ef628ee1060 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee1067 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135752.580516:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135752.580553:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135752.580586:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675342480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135752.582180:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809246336 00000100:00100000:1.0:1783135752.582193:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809246336 00000100:00100000:1.0:1783135752.582263:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783135752.582274:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:17061:x1869752809246336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135752.582435:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:17061:x1869752809246336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.582454:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783135752.582493:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135752.582540:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135752.582593:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135752.582629:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675342480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135752.582932:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809246464 00000100:00100000:1.0:1783135752.582938:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809246464 00000100:00100000:1.0:1783135752.582969:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783135752.582977:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:17061:x1869752809246464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135752.583061:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:17061:x1869752809246464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135752.583067:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783135752.583240:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783135752.592305:0:20162:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783135752.592488:0:17061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783135752.592536:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135752.592550:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f200/0xf7de4ef628ee1060 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1067 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135752.592562:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e20f200/0xf7de4ef628ee1060 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1067 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135752.592572:0:17061:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135752.592574:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac5424bf000 from 13 10000000:01000000:1.0:1783135752.592577:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135752.592616:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628ee106e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135752.592625:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628ee106e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135752.592636:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628ee106e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135752.592664:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac5441be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135752.592733:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135752.592780:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135752.593177:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809246592 00000100:00100000:0.0:1783135752.593185:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809246592 00000100:00100000:0.0:1783135752.593231:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783135752.593241:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+22:17061:x1869752809246592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135752.593256:0:17056:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135752.593269:0:17056:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67e64b400/0xf7de4ef628ee1075 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee106e expref: -99 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135752.593294:0:17056:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67e64b400/0xf7de4ef628ee1075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee106e expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135752.593304:0:17056:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67e64b400/0xf7de4ef628ee1075 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee106e expref: 23 pid: 17056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135752.593320:0:17056:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64b400, rc 0) 00000100:00100000:0.0:1783135752.593365:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:17061:x1869752809246592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135752.593372:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783135752.593420:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac5441be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135752.593432:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628ee106e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1075 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135752.593451:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628ee106e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee1075 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135752.593941:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135752.593969:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135752.594028:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac672e65480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135752.602602:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809246720 00000100:00100000:3.0:1783135752.602619:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809246720 00000100:00100000:0.0:1783135752.603352:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783135752.603368:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:17061:x1869752809246720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135752.605572:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:17061:x1869752809246720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1105us (10497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135752.605587:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1783135752.605710:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135752.605769:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135752.607035:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.618158:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac543987900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135752.621781:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809246848 00000100:00100000:1.0:1783135752.621799:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809246848 00000100:00100000:3.0:1783135752.621920:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783135752.621994:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:17061:x1869752809246848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135752.622191:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:17061:x1869752809246848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 259us (15157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135752.622211:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783135752.622331:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783135752.623733:0:20164:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783135752.624060:0:17061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783135752.624116:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135752.624130:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628ee106e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1075 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.624143:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67e20ec00/0xf7de4ef628ee106e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1075 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135752.624154:0:17061:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135752.624158:0:17061:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8ac678352000 from 13 10000000:01000000:2.0:1783135752.624166:0:17061:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135752.624205:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65da00/0xf7de4ef628ee107c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.624213:0:17061:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8ac67c65da00/0xf7de4ef628ee107c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.624224:0:17061:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8ac67c65da00/0xf7de4ef628ee107c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135752.624251:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135752.624320:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.624364:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac641254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135752.624615:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809246976 00000100:00100000:3.0:1783135752.624622:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809246976 00000100:00100000:3.0:1783135752.624655:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1783135752.624664:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+23:17061:x1869752809246976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135752.624676:0:17059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135752.624689:0:17059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ac67c526200/0xf7de4ef628ee1083 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf7de4ef628ee107c expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135752.624713:0:17059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ac67c526200/0xf7de4ef628ee1083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf7de4ef628ee107c expref: 24 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135752.624723:0:17059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ac67c526200/0xf7de4ef628ee1083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf7de4ef628ee107c expref: 24 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135752.624731:0:17059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c526200, rc 0) 00000100:00100000:3.0:1783135752.624779:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:17061:x1869752809246976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135752.624785:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1783135752.624866:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809246976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135752.624881:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8ac67c65da00/0xf7de4ef628ee107c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1083 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135752.624889:0:17061:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8ac67c65da00/0xf7de4ef628ee107c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf7de4ef628ee1083 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135752.624943:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809247104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135752.624970:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.624991:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac641254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135752.627652:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809247104 00000100:00100000:3.0:1783135752.627666:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809247104 00000100:00100000:3.0:1783135752.627720:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783135752.627730:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:17061:x1869752809247104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135752.627911:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:17061:x1869752809247104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (2938us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135752.627919:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1783135752.628682:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809247104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135752.628756:0:17061:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809247232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135752.628808:0:17061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135752.628834:0:17061:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac641254cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135752.629907:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809247232 00000100:00100000:3.0:1783135752.629915:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809247232 00000100:00100000:3.0:1783135752.629958:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1783135752.629967:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:17061:x1869752809247232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135752.630109:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:17061:x1869752809247232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135752.630117:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783135752.630820:0:17061:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:17061:1869752809247232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783135752.636617:0:20165:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783135752.636933:0:17061:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783135752.636961:0:17061:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135752.636974:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8ac67c65da00/0xf7de4ef628ee107c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1083 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135752.636986:0:17061:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8ac67c65da00/0xf7de4ef628ee107c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf7de4ef628ee1083 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135753.582818:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135753.583123:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135753.583146:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67e2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809247360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135753.583826:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135753.584044:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809247360 00000100:00100000:0.0:1783135753.584052:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809247360 00000100:00100000:0.0:1783135753.584114:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783135753.584124:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5441be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809247360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783135753.584152:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1783135753.584794:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5441be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809247360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 669us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135753.584803:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135753.585303:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67e2a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809247360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783135753.783216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135753.783251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135753.783283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135753.783312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135753.783329:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135753.783347:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135753.783375:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135753.783391:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135753.783410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135753.783462:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786090496 00000100:00100000:2.0:1783135753.783481:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786090496 00000100:00100000:2.0:1783135753.783551:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786091008 00000100:00100000:2.0:1783135753.783553:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786091008 00000100:00100000:2.0:1783135753.783566:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786090368 00000100:00100000:2.0:1783135753.783568:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786090368 00000100:00100000:2.0:1783135753.783578:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786090880 00000100:00100000:2.0:1783135753.783581:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786090880 00000100:00100000:2.0:1783135753.783716:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:2.0:1783135753.783731:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2398:x1869752786090496:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135753.783823:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2398:x1869752786090496:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 97us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135753.783831:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:2.0:1783135753.783849:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:2.0:1783135753.783854:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:06406641-6839-4a1a-8419-9f7c420b54d1+5:2398:x1869752786091008:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135753.783872:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:06406641-6839-4a1a-8419-9f7c420b54d1+5:2398:x1869752786091008:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 19us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135753.783898:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:2.0:1783135753.783909:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:2.0:1783135753.783914:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2398:x1869752786090368:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135753.783934:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2398:x1869752786090368:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 20us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135753.783940:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:2.0:1783135753.783947:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:2.0:1783135753.783952:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:06406641-6839-4a1a-8419-9f7c420b54d1+5:2398:x1869752786090880:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135753.783968:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:06406641-6839-4a1a-8419-9f7c420b54d1+5:2398:x1869752786090880:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 15us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135753.783973:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:2.0:1783135753.783989:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786090240 00000100:00100000:2.0:1783135753.783992:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786090240 00000100:00100000:2.0:1783135753.784010:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786090752 00000100:00100000:2.0:1783135753.784012:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786090752 00000100:00100000:2.0:1783135753.784021:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786090112 00000100:00100000:2.0:1783135753.784023:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786090112 00000100:00100000:2.0:1783135753.784032:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786090624 00000100:00100000:2.0:1783135753.784034:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786090624 00000100:00100000:2.0:1783135753.784045:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1783135753.784050:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2398:x1869752786090240:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135753.784073:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2398:x1869752786090240:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 23us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135753.784079:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1783135753.784117:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:2.0:1783135753.784128:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+5:2398:x1869752786090752:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135753.784151:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+5:2398:x1869752786090752:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 23us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135753.784157:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:2.0:1783135753.784166:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:2.0:1783135753.784171:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:2398:x1869752786090112:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135753.784188:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e2a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:2398:x1869752786090112:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 17us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135753.784193:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:2.0:1783135753.784201:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:2.0:1783135753.784207:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+6:2398:x1869752786090624:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1783135753.784222:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+6:2398:x1869752786090624:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 16us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135753.784228:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:0.0:1783135753.784999:0:17058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786089984 00000100:00100000:0.0:1783135753.785008:0:17058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786089984 00000100:00100000:0.0:1783135753.785067:0:17058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 168 00000100:00100000:0.0:1783135753.785075:0:17058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+13:2398:x1869752786089984:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1783135753.785161:0:17058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:455f3cf7-16ee-408c-8389-ea23e4967612+13:2398:x1869752786089984:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 87us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135753.785168:0:17058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 168 00000100:00080000:1.0:1783135753.786063:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135753.786124:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135753.786129:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135753.786133:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1783135753.971062:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783135754.096022:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809247488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135754.096163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135754.096326:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809247488 00000100:00100000:0.0:1783135754.096337:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809247488 00000100:00100000:0.0:1783135754.096418:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783135754.096431:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809247488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135754.096488:0:17070:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1783135754.096562:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809247488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135754.096570:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783135754.096943:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809247488:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1783135754.606255:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135754.608127:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809247616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135754.608247:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135754.608664:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809247616 00000100:00100000:3.0:1783135754.608675:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809247616 00000100:00100000:3.0:1783135754.608758:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783135754.608770:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809247616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783135754.608825:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783135754.608891:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809247616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135754.608898:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783135754.609561:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543a77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809247616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135755.021728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135755.021824:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786091136 00000100:00100000:0.0:1783135755.021839:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786091136 00000100:00100000:0.0:1783135755.021940:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1783135755.021954:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:15584:x1869752786091136:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135755.021994:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135755.022026:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee108a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410cd expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022188:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1091 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022206:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022347:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022370:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1098 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022378:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022384:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022512:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a600/0xf7de4ef628ee109f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022520:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a600/0xf7de4ef628ee109f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022527:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a600/0xf7de4ef628ee109f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135755.022565:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135755.022570:0:17066:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135755.022625:0:17066:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a600/0xf7de4ef628ee109f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022648:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022655:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1091 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022662:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1091 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022669:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64a800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135755.022674:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1091 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022682:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1091 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022697:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6508cf200) 00010000:00010000:0.0:1783135755.022700:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135755.022705:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1091 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022710:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1091 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022727:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022733:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1098 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022738:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1098 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022750:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64a200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135755.022753:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1098 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022760:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1098 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022769:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ac5424cd100) 00010000:00010000:0.0:1783135755.022772:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135755.022774:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1098 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022780:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1098 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022820:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee108a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410cd expref: 8 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022835:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a600/0xf7de4ef628ee109f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410cd expref: 7 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.022843:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ac5424cdd00) 00010000:00010000:0.0:1783135755.022846:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135755.022848:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64a600, rc 0) 00000100:00100000:0.0:1783135755.022936:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:15584:x1869752786091136:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 986us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135755.022945:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00080000:1.0:1783135755.023354:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135755.032752:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.036912:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786091264 00000100:00100000:2.0:1783135755.036938:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786091264 00000100:00100000:2.0:1783135755.037050:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:2.0:1783135755.037065:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:15584:x1869752786091264:12345-192.168.204.6@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783135755.037292:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:15584:x1869752786091264:12345-192.168.204.6@tcp:900:lhsmtool_posix.0 Request processed in 230us (4556us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135755.037321:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:2.0:1783135755.051697:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135755.051827:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786091520 00000100:00100000:1.0:1783135755.051841:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786091520 00000100:00100000:1.0:1783135755.051928:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:1.0:1783135755.051940:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:15584:x1869752786091520:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135755.051968:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135755.051993:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee10a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410d4 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.052134:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10ad lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.052153:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.052167:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.058319:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.058346:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.058519:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059469:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fe00/0xf7de4ef628ee10bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059483:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fe00/0xf7de4ef628ee10bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059493:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fe00/0xf7de4ef628ee10bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135755.059508:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1783135755.059681:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059688:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10ad lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059696:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059701:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20fa00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135755.059706:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059713:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10ad lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059728:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ac5424cdd00) 00010000:00010000:1.0:1783135755.059731:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135755.059736:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059751:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059768:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059774:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10b4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059780:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059785:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20fc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135755.059788:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059795:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10b4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059803:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ac6508cfd00) 00010000:00010000:1.0:1783135755.059805:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135755.059809:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10b4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.059815:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10b4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.063046:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee10a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410d4 expref: 10 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.063133:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fe00/0xf7de4ef628ee10bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410d4 expref: 9 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.063143:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac6508cfa00) 00010000:00010000:1.0:1783135755.063146:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135755.063149:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20fe00, rc 0) 00000100:00100000:1.0:1783135755.063224:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+9:15584:x1869752786091520:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 11285us (11541us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783135755.063234:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:3.0:1783135755.068992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.069316:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786091648 00000100:00100000:2.0:1783135755.069327:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786091648 00000100:00100000:2.0:1783135755.069411:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:2.0:1783135755.069422:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+9:15584:x1869752786091648:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783135755.069542:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+9:15584:x1869752786091648:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 Request processed in 122us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135755.069548:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:0.0:1783135755.071539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.071644:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786091776 00000100:00100000:2.0:1783135755.071652:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786091776 00000100:00100000:2.0:1783135755.071748:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:2.0:1783135755.071759:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:15584:x1869752786091776:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1783135755.075113:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1783135755.076816:0:17772:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5024us 00000100:00100000:2.0:1783135755.090500:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:15584:x1869752786091776:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 Request processed in 18732us (18956us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135755.090516:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:3.0:1783135755.113699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135755.113824:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786091904 00000100:00100000:0.0:1783135755.113834:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786091904 00000100:00100000:0.0:1783135755.113952:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:0.0:1783135755.113963:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+9:15590:x1869752786091904:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135755.113987:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135755.114007:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee10c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410db expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114068:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee10d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114082:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee10d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114118:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee10d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114164:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee10d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114172:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee10d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114179:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee10d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114222:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee10d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114229:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee10d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114254:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee10d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114261:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64a800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135755.114265:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee10d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114273:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee10d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114285:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6508cf200) 00010000:00010000:0.0:1783135755.114288:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135755.114293:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee10d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114300:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee10d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114312:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee10d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114317:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee10d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114324:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee10d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114329:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64aa00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135755.114332:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee10d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114345:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee10d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114352:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ac5424cd100) 00010000:00010000:0.0:1783135755.114355:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135755.114357:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee10d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114363:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee10d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114405:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee10c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410db expref: 10 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114416:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6508cf200) 00010000:00010000:0.0:1783135755.114419:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135755.114431:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee10c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410db expref: 10 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.114440:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64a200, rc 0) 00000100:00100000:0.0:1783135755.114510:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+9:15590:x1869752786091904:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 549us (820us total) trans 0 rc 301/301 00000100:00100000:0.0:1783135755.114517:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:1.0:1783135755.129072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135755.129216:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786092032 00000100:00100000:3.0:1783135755.129226:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786092032 00000100:00100000:3.0:1783135755.129273:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:3.0:1783135755.129284:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:07e1865a-1721-4bc6-87c1-03d8d78664fd+9:15590:x1869752786092032:12345-192.168.204.6@tcp:700:lfs.0 00000100:00100000:3.0:1783135755.129417:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:07e1865a-1721-4bc6-87c1-03d8d78664fd+9:15590:x1869752786092032:12345-192.168.204.6@tcp:700:lfs.0 Request processed in 134us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135755.129426:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:3.0:1783135755.131809:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135755.131967:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786092288 00000100:00100000:1.0:1783135755.131976:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786092288 00000100:00100000:1.0:1783135755.132033:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:1.0:1783135755.132043:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+9:15590:x1869752786092288:12345-192.168.204.6@tcp:36:lfs.0 00010000:00010000:1.0:1783135755.132128:0:17065:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135755.132154:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee0ff7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141048 expref: 9 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.132175:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6508cf200) 00010000:00010000:1.0:1783135755.132180:0:17065:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135755.132239:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.132254:0:17065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410b8 expref: 5 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.132281:0:17065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.132315:0:17065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410b8 expref: 5 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.132329:0:17065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410b8 expref: 5 pid: 17066 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135755.132342:0:17065:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17065:1869752809247744:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135755.132450:0:17065:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135755.135932:0:17065:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac6434f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17065:1869752809247744:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135755.135962:0:17065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135755.141920:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135755.142226:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786092416 00000100:00100000:0.0:1783135755.142239:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786092416 00010000:00010000:0.0:1783135755.142299:0:18599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410b8 expref: 6 pid: 17066 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135755.142377:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:0.0:1783135755.142387:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06406641-6839-4a1a-8419-9f7c420b54d1+6:2401:x1869752786092416:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135755.142413:0:18599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135755.142420:0:18599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410b8 expref: 6 pid: 17066 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.142445:0:18599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410b8 expref: 6 pid: 17066 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.142467:0:18599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1036 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410b8 expref: 6 pid: 17066 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.142484:0:18599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6508cf200) 00010000:00010000:0.0:1783135755.142489:0:18599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.142499:0:18599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.142506:0:18599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.142531:0:18599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135755.142580:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06406641-6839-4a1a-8419-9f7c420b54d1+5:2401:x1869752786092416:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 194us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135755.142588:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00080000:1.0:1783135755.142690:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783135755.142706:0:17065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.142714:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.142738:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.142748:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.142766:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144418:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144449:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144460:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135755.144476:0:17065:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb5b2691 reply state 00000000c0e8c156 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144488:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144496:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:1.0:1783135755.144499:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135755.144502:0:17065:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783135755.144508:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783135755.144515:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144522:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144529:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144534:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20fc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135755.144544:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144552:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144564:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac6508cf200) 00010000:00010000:1.0:1783135755.144566:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135755.144570:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144577:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee10de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135755.144595:0:17065:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb5b2691 reply state 00000000c0e8c156 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144603:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.144609:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ac6508cfd00) 00010000:00010000:1.0:1783135755.144611:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135755.144613:0:17065:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1783135755.144701:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+10:15590:x1869752786092288:12345-192.168.204.6@tcp:36:lfs.0 Request processed in 12656us (12898us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783135755.144710:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:0.0:1783135755.283207:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.283378:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786092544 00000100:00100000:2.0:1783135755.283397:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786092544 00000100:00100000:2.0:1783135755.283467:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:2.0:1783135755.283477:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+10:15598:x1869752786092544:12345-192.168.204.6@tcp:101:lctl.0 00010000:00010000:2.0:1783135755.283503:0:17064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135755.283529:0:17064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee10f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410e2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.283611:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65dc00/0xf7de4ef628ee10fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.283626:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65dc00/0xf7de4ef628ee10fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.283787:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65dc00/0xf7de4ef628ee10fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135755.283840:0:17064:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135755.283844:0:17064:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135755.283880:0:17064:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65dc00/0xf7de4ef628ee10fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.283905:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee10f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410e2 expref: 12 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.283921:0:17064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65dc00/0xf7de4ef628ee10fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410e2 expref: 11 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.283929:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac67c558100) 00010000:00010000:2.0:1783135755.283931:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135755.283936:0:17064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65dc00, rc 0) 00000100:00100000:2.0:1783135755.284062:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+11:15598:x1869752786092544:12345-192.168.204.6@tcp:101:lctl.0 Request processed in 585us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135755.284069:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:3.0:1783135755.337765:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.337868:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786092672 00000100:00100000:2.0:1783135755.337879:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786092672 00000100:00100000:2.0:1783135755.337969:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:2.0:1783135755.337980:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06406641-6839-4a1a-8419-9f7c420b54d1+5:15600:x1869752786092672:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135755.338001:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135755.338021:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410e9 expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.338082:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ce00/0xf7de4ef628ee1108 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.338124:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ce00/0xf7de4ef628ee1108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.338136:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ce00/0xf7de4ef628ee1108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135755.338181:0:17772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135755.338186:0:17772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135755.338218:0:17772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ce00/0xf7de4ef628ee1108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.338244:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410e9 expref: 7 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.338264:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ce00/0xf7de4ef628ee1108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410e9 expref: 6 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.338272:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac67c558100) 00010000:00010000:2.0:1783135755.338275:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135755.338279:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65ce00, rc 0) 00000100:00100000:2.0:1783135755.338338:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:06406641-6839-4a1a-8419-9f7c420b54d1+6:15600:x1869752786092672:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 360us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135755.338352:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:3.0:1783135755.352449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135755.352632:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786092800 00000100:00100000:0.0:1783135755.352653:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786092800 00000100:00100000:0.0:1783135755.352716:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:0.0:1783135755.352728:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+6:15600:x1869752786092800:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135755.352750:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135755.352769:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee110f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410f0 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.352834:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1116 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.352848:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.352859:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.352870:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ac00/0xf7de4ef628ee111d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.352878:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ac00/0xf7de4ef628ee111d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.352884:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ac00/0xf7de4ef628ee111d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.352968:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1124 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.352977:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1124 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353001:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1124 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135755.353045:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783135755.353048:0:17066:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783135755.353069:0:17066:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1124 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353082:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353120:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1116 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353127:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1116 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353133:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64a800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135755.353137:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1116 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353144:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1116 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353157:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac67c558100) 00010000:00010000:0.0:1783135755.353160:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135755.353164:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353170:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee1116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353192:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ac00/0xf7de4ef628ee111d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353198:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ac00/0xf7de4ef628ee111d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353203:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ac00/0xf7de4ef628ee111d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353208:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64ac00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135755.353211:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ac00/0xf7de4ef628ee111d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353218:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ac00/0xf7de4ef628ee111d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353226:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ac6508cfd00) 00010000:00010000:0.0:1783135755.353229:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135755.353232:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ac00/0xf7de4ef628ee111d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353238:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ac00/0xf7de4ef628ee111d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353261:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64aa00/0xf7de4ef628ee110f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410f0 expref: 8 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353274:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1124 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410f0 expref: 7 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.353293:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:0.0:1783135755.353295:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135755.353297:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64a200, rc 0) 00000100:00100000:0.0:1783135755.353372:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+7:15600:x1869752786092800:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 634us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135755.353379:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:0.0:1783135755.359647:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.359782:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786092928 00000100:00100000:2.0:1783135755.359792:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786092928 00000100:00100000:2.0:1783135755.359865:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:2.0:1783135755.359876:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:06406641-6839-4a1a-8419-9f7c420b54d1+5:15600:x1869752786092928:12345-192.168.204.6@tcp:900:lfs.0 00000100:00100000:2.0:1783135755.359996:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:06406641-6839-4a1a-8419-9f7c420b54d1+5:15600:x1869752786092928:12345-192.168.204.6@tcp:900:lfs.0 Request processed in 121us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135755.360005:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00080000:1.0:1783135755.360119:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783135755.371937:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135755.372550:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786093184 00000100:00100000:1.0:1783135755.372560:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786093184 00000100:00100000:1.0:1783135755.372621:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:1.0:1783135755.372632:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+7:15600:x1869752786093184:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135755.372679:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135755.372697:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee112b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410f7 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135755.372790:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783135755.372889:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee112b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410f7 expref: 9 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.372903:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac67c558100) 00010000:00010000:1.0:1783135755.372906:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135755.372911:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee112b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410f7 expref: 9 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.372927:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20fc00, rc 0) 00000100:00100000:1.0:1783135755.372999:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+8:15600:x1869752786093184:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 368us (1071us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1783135755.373006:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 32 00000040:00080000:1.0:1783135755.376897:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783135755.385630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.385780:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786093440 00000100:00100000:2.0:1783135755.385790:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786093440 00000100:00100000:2.0:1783135755.385851:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:2.0:1783135755.385861:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+8:15600:x1869752786093440:12345-192.168.204.6@tcp:36:lfs.0 00010000:00010000:2.0:1783135755.385918:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135755.385957:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a200/0xf7de4ef628ee1124 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410f0 expref: 8 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.385977:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:2.0:1783135755.385982:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135755.386004:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.386017:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.386027:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135755.386509:0:17066:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007e536a1a reply state 00000000eaccdbe8 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.386536:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.386544:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:2.0:1783135755.386547:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1783135755.386549:0:17066:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783135755.386558:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1783135755.388035:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:06406641-6839-4a1a-8419-9f7c420b54d1+9:15600:x1869752786093440:12345-192.168.204.6@tcp:36:lfs.0 Request processed in 779us (1017us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783135755.388050:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:0.0:1783135755.392866:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135755.395570:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786093696 00000100:00100000:3.0:1783135755.395588:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786093696 00000100:00100000:3.0:1783135755.395673:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:3.0:1783135755.395685:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06406641-6839-4a1a-8419-9f7c420b54d1+9:15600:x1869752786093696:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135755.405070:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06406641-6839-4a1a-8419-9f7c420b54d1+10:15600:x1869752786093696:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 9372us (12198us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783135755.405101:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:2.0:1783135755.413589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135755.413668:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786093952 00000100:00100000:1.0:1783135755.413677:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786093952 00000100:00100000:1.0:1783135755.413734:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:1.0:1783135755.413746:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+10:15600:x1869752786093952:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1783135755.413770:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135755.413787:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f1410fe expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.413858:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1147 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.413888:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1147 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.413900:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1147 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.413912:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee114e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.413919:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee114e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.413925:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee114e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135755.414663:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783135755.414741:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1147 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414749:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1147 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414756:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1147 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414762:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20fc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135755.414766:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1147 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414773:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1147 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414787:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac67c558100) 00010000:00010000:0.0:1783135755.414790:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135755.414803:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1147 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414810:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1147 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414825:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee114e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414831:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee114e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414836:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee114e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414841:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135755.414844:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee114e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414850:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee114e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414858:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ac6508cfd00) 00010000:00010000:0.0:1783135755.414861:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135755.414864:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee114e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414870:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee114e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414905:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1140 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410fe expref: 12 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414926:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac67c558100) 00010000:00010000:0.0:1783135755.414929:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135755.414933:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f1410fe expref: 12 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.414943:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e400, rc 0) 00000100:00100000:0.0:1783135755.415019:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+11:15600:x1869752786093952:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1275us (1439us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1783135755.415028:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:1.0:1783135755.418147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.418243:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786094080 00000100:00100000:2.0:1783135755.418253:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786094080 00000100:00100000:2.0:1783135755.418302:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:2.0:1783135755.418312:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06406641-6839-4a1a-8419-9f7c420b54d1+11:15600:x1869752786094080:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1783135755.418334:0:17064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135755.418352:0:17064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c800/0xf7de4ef628ee115c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141105 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.418471:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.418486:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.418497:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135755.418524:0:17064:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135755.418541:0:17064:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135755.418563:0:17064:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.418591:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c800/0xf7de4ef628ee115c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141105 expref: 13 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.418611:0:17064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141105 expref: 12 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.418620:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:2.0:1783135755.418623:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135755.418626:0:17064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65de00, rc 0) 00000100:00100000:2.0:1783135755.418696:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:06406641-6839-4a1a-8419-9f7c420b54d1+12:15600:x1869752786094080:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 385us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135755.418702:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:3.0:1783135755.428907:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135755.429122:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786094208 00000100:00100000:0.0:1783135755.429133:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786094208 00000100:00100000:0.0:1783135755.429187:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:0.0:1783135755.429207:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06406641-6839-4a1a-8419-9f7c420b54d1+12:15600:x1869752786094208:12345-192.168.204.6@tcp:37:lfs.0 00000100:00100000:0.0:1783135755.436164:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:06406641-6839-4a1a-8419-9f7c420b54d1+12:15600:x1869752786094208:12345-192.168.204.6@tcp:37:lfs.0 Request processed in 6956us (7256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135755.436178:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:1.0:1783135755.446290:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135755.446352:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786094464 00000100:00100000:3.0:1783135755.446362:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786094464 00000100:00100000:3.0:1783135755.446435:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:3.0:1783135755.446444:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543772c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06406641-6839-4a1a-8419-9f7c420b54d1+12:15600:x1869752786094464:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135755.446669:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543772c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:06406641-6839-4a1a-8419-9f7c420b54d1+13:15600:x1869752786094464:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 225us (387us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1783135755.446677:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:3.0:1783135755.528085:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.528205:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786094592 00000100:00100000:2.0:1783135755.528216:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786094592 00000100:00100000:2.0:1783135755.528261:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:2.0:1783135755.528271:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+11:15606:x1869752786094592:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1783135755.528308:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135755.528327:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee116a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f14110c expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528395:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee1171 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528410:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee1171 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528447:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee1171 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528459:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1178 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528467:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528474:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528562:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c400/0xf7de4ef628ee117f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528571:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c400/0xf7de4ef628ee117f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528578:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c400/0xf7de4ef628ee117f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135755.528611:0:17772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1783135755.528614:0:17772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135755.528947:0:17772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c400/0xf7de4ef628ee117f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528962:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee1171 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528969:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee1171 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528986:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee1171 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.528992:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65cc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135755.528995:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee1171 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529003:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee1171 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529016:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac67c558100) 00010000:00010000:2.0:1783135755.529018:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135755.529022:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee1171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529029:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee1171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529042:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529048:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1178 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529054:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1178 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529059:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135755.529062:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1178 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529076:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1178 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529083:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ac6508cfd00) 00010000:00010000:2.0:1783135755.529130:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135755.529134:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1178 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529140:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1178 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529167:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee116a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14110c expref: 13 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529180:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c400/0xf7de4ef628ee117f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14110c expref: 12 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.529187:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:2.0:1783135755.529190:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783135755.529192:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c400, rc 0) 00000100:00100000:2.0:1783135755.529253:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+12:15606:x1869752786094592:12345-192.168.204.6@tcp:101:bash.0 Request processed in 984us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135755.529261:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:2.0:1783135755.534720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135755.534927:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786094720 00000100:00100000:0.0:1783135755.534938:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786094720 00000100:00100000:0.0:1783135755.534995:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:0.0:1783135755.535004:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:15606:x1869752786094720:12345-192.168.204.6@tcp:900:bash.0 00000100:00100000:0.0:1783135755.535115:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:15606:x1869752786094720:12345-192.168.204.6@tcp:900:bash.0 Request processed in 112us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135755.535123:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:1.0:1783135755.545770:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.545972:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786094976 00000100:00100000:2.0:1783135755.545983:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786094976 00000100:00100000:2.0:1783135755.546042:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:2.0:1783135755.546052:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+12:15606:x1869752786094976:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1783135755.546083:0:17064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135755.546137:0:17064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1186 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141113 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.546240:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.546255:0:17064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141105 expref: 12 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.546264:0:17064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.546300:0:17064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141105 expref: 12 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.546314:0:17064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141105 expref: 12 pid: 17064 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135755.546328:0:17064:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c653480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17064:1869752809247872:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135755.546425:0:17064:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6467c3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135755.552509:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.552635:0:17064:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c653480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17064:1869752809247872:192.168.204.6@tcp:104: 00010000:00010000:2.0:1783135755.552671:0:17064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135755.553295:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786095104 00000100:00100000:0.0:1783135755.553317:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786095104 00010000:00010000:0.0:1783135755.553351:0:17051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141105 expref: 13 pid: 17064 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135755.553400:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:0.0:1783135755.553409:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06406641-6839-4a1a-8419-9f7c420b54d1+13:2400:x1869752786095104:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135755.553423:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135755.553430:0:17051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141105 expref: 13 pid: 17064 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.553442:0:17051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141105 expref: 13 pid: 17064 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.553463:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1163 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141105 expref: 13 pid: 17064 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.553480:0:17051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:0.0:1783135755.553484:0:17051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.553495:0:17051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.553503:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.553534:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135755.553588:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06406641-6839-4a1a-8419-9f7c420b54d1+12:2400:x1869752786095104:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 179us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135755.553605:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00010000:00010000:1.0:1783135755.553939:0:17064:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.553948:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.553972:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.553983:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554003:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554496:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554506:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554513:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135755.554524:0:17064:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783135755.554547:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554554:0:17064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554560:0:17064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554566:0:17064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:1.0:1783135755.554570:0:17064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554578:0:17064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554586:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:1.0:1783135755.554588:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135755.554597:0:17064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554603:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee118d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135755.554615:0:17064:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000050d6532d reply state 00000000e8cccf83 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554639:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.554646:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ac6508cf200) 00010000:00010000:1.0:1783135755.554648:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135755.554651:0:17064:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783135755.557108:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1186 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141113 expref: 15 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.557137:0:17064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141113 expref: 14 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135755.557146:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:1.0:1783135755.557149:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783135755.557152:0:17064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20fc00, rc 0) 00000100:00100000:1.0:1783135755.557224:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+15:15606:x1869752786094976:12345-192.168.204.6@tcp:101:bash.0 Request processed in 11173us (11463us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783135755.557233:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:1.0:1783135755.575943:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.578013:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786095232 00000100:00100000:2.0:1783135755.578027:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786095232 00000100:00100000:2.0:1783135755.578144:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:2.0:1783135755.578167:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+15:15606:x1869752786095232:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1783135755.578190:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135755.578210:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee11a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f14111a expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.578282:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.578296:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.578307:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135755.578360:0:17772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783135755.578365:0:17772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135755.578381:0:17772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.578402:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.578530:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65cc00/0xf7de4ef628ee11a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14111a expref: 17 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.578550:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14111a expref: 16 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135755.578558:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:2.0:1783135755.578561:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135755.578570:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65ca00, rc 0) 00000100:00100000:2.0:1783135755.578696:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+16:15606:x1869752786095232:12345-192.168.204.6@tcp:101:bash.0 Request processed in 531us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135755.578704:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:3.0:1783135755.583205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.583426:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786095488 00000100:00100000:2.0:1783135755.583436:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786095488 00000100:00100000:2.0:1783135755.583495:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:2.0:1783135755.583505:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543a76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+16:15606:x1869752786095488:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:2.0:1783135755.584152:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543a76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+17:15606:x1869752786095488:12345-192.168.204.6@tcp:35:bash.0 Request processed in 289us (597us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1783135755.584163:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00010000:00010000:0.0:1783135755.630228:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135755.713548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135755.713683:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786095744 00000100:00100000:0.0:1783135755.713694:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786095744 00000100:00100000:0.0:1783135755.713752:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:0.0:1783135755.713761:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac5438ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+17:15616:x1869752786095744:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135755.713786:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135755.713816:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee11b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141121 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135755.713913:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1783135755.714004:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee11b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141121 expref: 19 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.714018:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ac67c558100) 00010000:00010000:0.0:1783135755.714021:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135755.714025:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee11b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141121 expref: 19 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.714039:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64a800, rc 0) 00000100:00100000:0.0:1783135755.714137:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac5438ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+18:15616:x1869752786095744:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 377us (598us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1783135755.714145:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:1.0:1783135755.725078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135755.725354:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786096000 00000100:00100000:3.0:1783135755.725365:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786096000 00000100:00100000:3.0:1783135755.725443:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:3.0:1783135755.725452:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+18:15616:x1869752786096000:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1783135755.726573:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+19:15616:x1869752786096000:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 1115us (1497us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1783135755.726584:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:3.0:1783135755.808828:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135755.808927:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786096256 00000100:00100000:0.0:1783135755.808937:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786096256 00000100:00100000:0.0:1783135755.808998:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:0.0:1783135755.809007:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+19:15619:x1869752786096256:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1783135755.809043:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135755.809062:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee11c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141128 expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.809212:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.809227:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.809239:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135755.809249:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783135755.809346:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64a800/0xf7de4ef628ee11c5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141128 expref: 22 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.809364:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141128 expref: 21 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.809372:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135755.809375:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135755.809390:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64b600, rc 0) 00000100:00100000:0.0:1783135755.809437:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543b3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+21:15619:x1869752786096256:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 432us (631us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1783135755.809445:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:1.0:1783135755.813180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135755.813320:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786096384 00000100:00100000:0.0:1783135755.813330:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786096384 00000100:00100000:0.0:1783135755.813394:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:0.0:1783135755.813410:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac6434f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+21:15619:x1869752786096384:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:0.0:1783135755.813481:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.813496:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.813508:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.813541:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.813557:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.813564:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.813570:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64bc00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135755.813575:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.813582:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.813593:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135755.813596:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135755.813601:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.813607:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135755.813687:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac6434f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+21:15619:x1869752786096384:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 279us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135755.813695:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:1.0:1783135755.816761:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135755.816795:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135755.816865:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786096768 00000100:00100000:2.0:1783135755.816874:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786096768 00000100:00100000:2.0:1783135755.816931:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:2.0:1783135755.816940:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+21:15619:x1869752786096768:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1783135755.817173:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+22:15619:x1869752786096768:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 233us (375us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1783135755.817180:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:0.0:1783135755.817405:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786096512 00000100:00100000:0.0:1783135755.817409:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786096512 00000100:00100000:0.0:1783135755.817449:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:0.0:1783135755.817456:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+22:2401:x1869752786096512:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135755.817467:0:18599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135755.817487:0:18599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141128 expref: 22 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135755.817508:0:18599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135755.817512:0:18599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135755.817531:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+21:2401:x1869752786096512:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 76us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135755.817537:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00000040:00080000:1.0:1783135756.014806:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783135756.197010:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135756.197070:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786097024 00000100:00100000:0.0:1783135756.197081:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786097024 00000100:00100000:0.0:1783135756.197228:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:0.0:1783135756.197238:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+21:15650:x1869752786097024:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:0.0:1783135756.197272:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135756.197293:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11e1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f14112f expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.197418:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.197440:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.197451:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135756.197464:0:17065:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783135756.198080:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11e1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14112f expref: 24 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.198124:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14112f expref: 23 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.198131:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135756.198133:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135756.198135:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64bc00, rc 0) 00000100:00100000:0.0:1783135756.198190:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+23:15650:x1869752786097024:12345-192.168.204.6@tcp:101:cat.0 Request processed in 954us (1200us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1783135756.198202:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:1.0:1783135756.206723:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135756.206766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135756.207077:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786097152 00000100:00100000:0.0:1783135756.207110:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786097152 00000100:00100000:0.0:1783135756.207192:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:0.0:1783135756.207202:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+23:2400:x1869752786097152:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135756.207226:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135756.207249:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14112f expref: 23 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.207287:0:17051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135756.207292:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135756.207349:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+22:2400:x1869752786097152:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 149us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135756.207357:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:2.0:1783135756.207630:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786097408 00000100:00100000:2.0:1783135756.207635:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786097408 00000100:00100000:2.0:1783135756.207664:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:2.0:1783135756.207671:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+22:15650:x1869752786097408:12345-192.168.204.6@tcp:35:cat.0 00000100:00100000:2.0:1783135756.207933:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+23:15650:x1869752786097408:12345-192.168.204.6@tcp:35:cat.0 Request processed in 261us (1164us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1783135756.207939:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:1.0:1783135756.288055:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135756.288321:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786097664 00000100:00100000:0.0:1783135756.288332:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786097664 00000100:00100000:0.0:1783135756.288509:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:0.0:1783135756.288522:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+23:15656:x1869752786097664:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:0.0:1783135756.288547:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135756.288569:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141136 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.288707:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.288723:0:17066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141113 expref: 24 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.288732:0:17066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14111a expref: 24 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.288741:0:17066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.288776:0:17066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14111a expref: 24 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.288812:0:17066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14111a expref: 24 pid: 17772 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135756.288838:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17066:1869752809248000:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135756.288940:0:17066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141113 expref: 24 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.288950:0:17066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141113 expref: 24 pid: 17064 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135756.288960:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17066:1869752809248128:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135756.288985:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675352180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135756.292071:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17066:1869752809248000:192.168.204.6@tcp:104: 00000100:00100000:0.0:1783135756.292108:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17066:1869752809248128:192.168.204.6@tcp:104: 00010000:00010000:0.0:1783135756.292137:0:17066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135756.293992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135756.294888:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786097792 00000100:00100000:0.0:1783135756.294899:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786097792 00010000:00010000:0.0:1783135756.294944:0:18599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14111a expref: 25 pid: 17772 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135756.295029:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:0.0:1783135756.295040:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+25:2401:x1869752786097792:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135756.295073:0:18599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135756.295080:0:18599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14111a expref: 25 pid: 17772 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.295110:0:18599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14111a expref: 25 pid: 17772 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.295132:0:18599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee11b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14111a expref: 25 pid: 17772 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.295148:0:18599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135756.295154:0:18599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.295775:0:18599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.295782:0:18599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135756.295869:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+24:2401:x1869752786097792:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 830us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135756.295878:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:2.0:1783135756.298054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135756.298327:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786097920 00000100:00100000:0.0:1783135756.298337:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786097920 00010000:00010000:0.0:1783135756.298383:0:17051:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141113 expref: 24 pid: 17064 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135756.298555:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:0.0:1783135756.298567:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+24:2401:x1869752786097920:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135756.298591:0:17051:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135756.298598:0:17051:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141113 expref: 24 pid: 17064 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.298610:0:17051:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141113 expref: 24 pid: 17064 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.298644:0:17051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee119b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141113 expref: 24 pid: 17064 timeout: 760 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.298661:0:17051:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135756.298666:0:17051:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.298676:0:17051:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.298692:0:17051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135756.298723:0:17051:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135756.298782:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+23:2401:x1869752786097920:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 217us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135756.298790:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00010000:00010000:2.0:1783135756.299810:0:17066:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.299834:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135756.299855:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783135756.300022:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64bc00/0xf7de4ef628ee11f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141136 expref: 24 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.300041:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64b600/0xf7de4ef628ee11fd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141136 expref: 23 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.300050:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:2.0:1783135756.300053:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135756.300056:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e64b600, rc 0) 00000100:00100000:2.0:1783135756.300136:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+23:15656:x1869752786097664:12345-192.168.204.6@tcp:101:dd.0 Request processed in 11617us (12090us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1783135756.300145:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:2.0:1783135756.304380:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135756.304517:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786098048 00000100:00100000:1.0:1783135756.304527:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786098048 00000100:00100000:1.0:1783135756.304596:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:1.0:1783135756.304605:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+23:15656:x1869752786098048:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:1.0:1783135756.304638:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135756.304660:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee120b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f14113d expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.304692:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.304707:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.304719:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.304971:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee120b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14113d expref: 25 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.304991:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14113d expref: 24 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.305011:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:1.0:1783135756.305014:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135756.305018:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20e400, rc 0) 00000100:00100000:1.0:1783135756.305083:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+24:15656:x1869752786098048:12345-192.168.204.6@tcp:101:dd.0 Request processed in 478us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135756.305130:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:3.0:1783135756.313225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135756.313413:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786098304 00000100:00100000:1.0:1783135756.313426:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786098304 00000100:00100000:1.0:1783135756.313496:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:1.0:1783135756.313506:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+24:15656:x1869752786098304:12345-192.168.204.6@tcp:36:dd.0 00010000:00010000:1.0:1783135756.313795:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.313812:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.313948:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135756.313996:0:17064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1783135756.314036:0:17064:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002ce853ef reply state 0000000074cd3a9e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.314050:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.314058:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:1.0:1783135756.314061:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783135756.314076:0:17064:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135756.315365:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+27:15656:x1869752786098304:12345-192.168.204.6@tcp:36:dd.0 Request processed in 1852us (2140us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1783135756.315387:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 45 00000020:00080000:1.0:1783135756.315394:0:17064:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783135756.320574:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135756.320691:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786098432 00000100:00100000:1.0:1783135756.320701:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786098432 00000100:00100000:1.0:1783135756.320801:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:1.0:1783135756.320811:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+27:15656:x1869752786098432:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:1.0:1783135756.320849:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135756.320872:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1220 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141144 expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.320931:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1220 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141144 expref: 28 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.320946:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1220 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141144 expref: 28 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135756.320966:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:1.0:1783135756.320970:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135756.320974:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67e20fc00, rc 0) 00000100:00100000:1.0:1783135756.321046:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+28:15656:x1869752786098432:12345-192.168.204.6@tcp:101:dd.0 Request processed in 236us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135756.321054:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:2.0:1783135756.335456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135756.335542:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786098688 00000100:00100000:3.0:1783135756.335552:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786098688 00000100:00100000:3.0:1783135756.335627:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:3.0:1783135756.335637:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+28:15656:x1869752786098688:12345-192.168.204.6@tcp:103:dd.0 00010000:00010000:3.0:1783135756.335654:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135756.335679:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fc00/0xf7de4ef628ee1220 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141144 expref: 28 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135756.335704:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:3.0:1783135756.335709:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135756.335776:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+27:15656:x1869752786098688:12345-192.168.204.6@tcp:103:dd.0 Request processed in 141us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135756.335784:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:3.0:1783135756.338720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135756.338813:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786098816 00000100:00100000:2.0:1783135756.338830:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786098816 00000100:00100000:2.0:1783135756.338889:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:2.0:1783135756.338899:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+27:15656:x1869752786098816:12345-192.168.204.6@tcp:58:dd.0 00010000:00010000:2.0:1783135756.339015:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.339035:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.339063:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135756.341030:0:17066:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135756.342315:0:17066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1783135756.342601:0:17066:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1783135756.342738:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+27:15656:x1869752786098816:12345-192.168.204.6@tcp:58:dd.0 Request processed in 3833us (4020us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135756.342760:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:1.0:1783135756.345325:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135756.345656:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786098944 00000100:00100000:2.0:1783135756.345665:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786098944 00000100:00100000:2.0:1783135756.345726:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:2.0:1783135756.345735:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+27:15656:x1869752786098944:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:2.0:1783135756.345758:0:17065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135756.345783:0:17065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee122e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f14114b expref: -99 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.345848:0:17065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.345860:0:17065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee122e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14114b expref: 28 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.345879:0:17065:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.345892:0:17065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee122e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14114b expref: 28 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.345906:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:2.0:1783135756.345909:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135756.345912:0:17065:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee122e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14114b expref: 28 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135756.345939:0:17065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d800, rc 0) 00000100:00100000:2.0:1783135756.346164:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+28:15656:x1869752786098944:12345-192.168.204.6@tcp:101:dd.0 Request processed in 429us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135756.346173:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 48 00010000:00010000:0.0:1783135756.654693:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135757.039472:0:17099:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783135757.039484:0:17099:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135757.039528:0:17099:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783135757.039540:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783135757.039681:0:17099:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17099:1869752809248256:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783135757.039785:0:17099:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317de40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135757.050225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135757.050859:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786099072 00000100:00100000:1.0:1783135757.050872:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786099072 00000100:00080000:2.0:1783135757.051064:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135757.051083:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:1.0:1783135757.051125:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+29:15657:x1869752786099072:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783135757.051169:0:17064:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783135757.051349:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+29:15657:x1869752786099072:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 228us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135757.051366:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:1.0:1783135757.056248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.056930:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786099200 00000100:00100000:2.0:1783135757.056956:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786099200 00000100:00100000:2.0:1783135757.057055:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:2.0:1783135757.057067:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+29:15657:x1869752786099200:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783135757.057208:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1235 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057231:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1235 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057246:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1235 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057265:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee123c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057273:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee123c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057279:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee123c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057309:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057338:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057369:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135757.057450:0:17772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783135757.057456:0:17772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783135757.057480:0:17772:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057493:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1235 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057513:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1235 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057521:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1235 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057536:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135757.057541:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1235 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057550:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1235 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057565:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac6508cfa00) 00010000:00010000:2.0:1783135757.057569:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135757.057575:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1235 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057594:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1235 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057614:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee123c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057633:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee123c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057640:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee123c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057646:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65de00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135757.057649:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee123c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057656:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee123c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057665:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ac67c558f00) 00010000:00010000:2.0:1783135757.057668:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135757.057671:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee123c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057676:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee123c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057693:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057699:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057711:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057717:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:2.0:1783135757.057720:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057726:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057735:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:2.0:1783135757.057738:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135757.057741:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.057746:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1243 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135757.057845:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+29:15657:x1869752786099200:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 Request processed in 779us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135757.057853:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:0.0:1783135757.058055:0:17099:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67b3b0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17099:1869752809248256:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135757.064321:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135757.064780:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786099456 00000100:00100000:3.0:1783135757.064814:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786099456 00000100:00100000:3.0:1783135757.064897:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:3.0:1783135757.064910:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+28:15657:x1869752786099456:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135757.064940:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135757.064969:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee124a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141152 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.065796:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1251 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.065825:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1251 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.065844:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1251 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135757.065862:0:17066:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783135757.065977:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1251 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.065986:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1251 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.066007:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1251 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.066014:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135757.066019:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1251 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.066028:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1251 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.066058:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:3.0:1783135757.066062:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783135757.066068:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1251 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.066075:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1251 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.066756:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee124a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141152 expref: 30 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.066773:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ac6508cfa00) 00010000:00010000:3.0:1783135757.066776:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135757.066781:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee124a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141152 expref: 30 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.066794:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527a00, rc 0) 00000100:00100000:3.0:1783135757.066941:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+29:15657:x1869752786099456:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 2032us (2635us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1783135757.066953:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:1.0:1783135757.072504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.072731:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786099584 00000100:00100000:2.0:1783135757.072745:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786099584 00000100:00100000:2.0:1783135757.072867:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:2.0:1783135757.072881:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+29:15657:x1869752786099584:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135757.072934:0:17772:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135757.073164:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67b3b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+29:15657:x1869752786099584:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 286us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135757.073191:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:1.0:1783135757.078305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.086810:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786099840 00000100:00100000:2.0:1783135757.086834:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786099840 00000100:00100000:2.0:1783135757.086951:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:2.0:1783135757.086965:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+29:15657:x1869752786099840:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135757.086995:0:17064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135757.087027:0:17064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee125f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141159 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783135757.087832:0:17064:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1783135757.087842:0:17064:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1783135757.087865:0:17064:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1783135757.090433:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1266 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.090457:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.090471:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1266 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.090584:0:17064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee125f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141159 expref: 32 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.090607:0:17064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1266 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141159 expref: 31 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.090694:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c558f00) 00010000:00010000:2.0:1783135757.090710:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135757.090714:0:17064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65de00, rc 0) 00000100:00100000:2.0:1783135757.096450:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+31:15657:x1869752786099840:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 9479us (18155us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1783135757.096463:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:0.0:1783135757.105529:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135757.105682:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786100096 00000100:00100000:3.0:1783135757.105695:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786100096 00000100:00100000:3.0:1783135757.105774:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:3.0:1783135757.105786:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+31:15657:x1869752786100096:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135757.105872:0:17065:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135757.105909:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee1266 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141159 expref: 31 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.105959:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c558f00) 00010000:00010000:3.0:1783135757.105974:0:17065:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135757.106004:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee1274 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106019:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee1274 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106029:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee1274 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106046:0:17065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee127b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x567fd9cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106054:0:17065:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee127b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x567fd9cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106060:0:17065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee127b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x567fd9cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106149:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee1274 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106156:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee1274 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106161:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee1274 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106166:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527a00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135757.106171:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee1274 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106185:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee1274 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106194:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:3.0:1783135757.106197:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135757.106202:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee1274 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106207:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee1274 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106217:0:17065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee127b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x567fd9cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106223:0:17065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee127b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x567fd9cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106229:0:17065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee127b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x567fd9cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.106233:0:17065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c527800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135757.106236:0:17065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee127b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x567fd9cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.107313:0:17065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee127b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x567fd9cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.107335:0:17065:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x567fd9cd (ffff8ac67c491a00) 00010000:00010000:3.0:1783135757.107338:0:17065:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135757.107343:0:17065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee127b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x567fd9cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.107384:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee127b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x567fd9cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135757.107823:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+30:15657:x1869752786100096:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 2033us (2303us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783135757.107835:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:1.0:1783135757.120939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135757.121045:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786100224 00000100:00100000:3.0:1783135757.121061:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786100224 00000100:00100000:3.0:1783135757.121179:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1783135757.121192:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+30:15657:x1869752786100224:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135757.121221:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135757.121497:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1282 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141160 expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.121546:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1289 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.121564:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1289 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.121577:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1289 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.121728:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee1282 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141160 expref: 32 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.121750:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527800/0xf7de4ef628ee1289 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141160 expref: 31 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.121773:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c491a00) 00010000:00010000:3.0:1783135757.121776:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135757.121781:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527800, rc 0) 00000100:00100000:3.0:1783135757.121964:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+31:15657:x1869752786100224:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 774us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135757.121973:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1783135757.125067:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.125628:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786100480 00000100:00100000:2.0:1783135757.125643:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786100480 00000100:00100000:2.0:1783135757.125760:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:2.0:1783135757.125773:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+31:15657:x1869752786100480:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135757.125932:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.125955:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.125970:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135757.126235:0:17772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1783135757.126246:0:17772:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 660919158104ns, next at 661919155192ns, rc = 0 00000004:00010000:2.0:1783135757.126306:0:17772:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073bec940 reply state 00000000b82cfbff transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.126323:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.126333:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c491a00) 00010000:00010000:2.0:1783135757.126336:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1783135757.126341:0:17772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135757.126514:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+33:15657:x1869752786100480:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 740us (1461us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1783135757.126531:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:0.0:1783135757.130189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.130379:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786100608 00000100:00100000:2.0:1783135757.130404:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786100608 00000100:00100000:2.0:1783135757.130489:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1783135757.130502:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+33:15657:x1869752786100608:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135757.130535:0:17064:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135757.130564:0:17064:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1297 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141167 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.130644:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1297 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141167 expref: 34 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.130663:0:17064:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1297 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141167 expref: 34 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.130686:0:17064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c491a00) 00010000:00010000:2.0:1783135757.130690:0:17064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135757.130695:0:17064:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65d600, rc 0) 00000100:00100000:2.0:1783135757.130940:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+34:15657:x1869752786100608:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 439us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135757.130950:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:1.0:1783135757.135297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.135489:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786100736 00000100:00100000:2.0:1783135757.136463:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786100736 00000100:00080000:1.0:1783135757.136906:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135757.137790:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1783135757.137833:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac675b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2401:x1869752786100736:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783135757.139633:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac675b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:2401:x1869752786100736:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 1814us (4336us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1783135757.139652:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:1.0:1783135757.145704:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.145839:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786100992 00000100:00100000:2.0:1783135757.145853:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786100992 00000100:00100000:2.0:1783135757.145933:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:2.0:1783135757.145945:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+34:15657:x1869752786100992:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783135757.146327:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+35:15657:x1869752786100992:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 382us (636us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1783135757.146337:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:1.0:1783135757.151835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135757.151999:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786101248 00000100:00100000:3.0:1783135757.152013:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786101248 00000100:00100000:2.0:1783135757.152133:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:2.0:1783135757.152148:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+35:15657:x1869752786101248:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135757.152337:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+35:15657:x1869752786101248:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 193us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135757.152345:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:1.0:1783135757.154947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.155507:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786101376 00000100:00100000:2.0:1783135757.155522:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786101376 00000100:00100000:3.0:1783135757.155759:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:3.0:1783135757.155777:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+35:15657:x1869752786101376:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135757.155810:0:17066:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135757.155840:0:17066:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee129e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f14116e expref: -99 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.156344:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee12a5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.156374:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee12a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.156389:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee12a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135757.156456:0:17066:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783135757.156481:0:17066:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee12a5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.156542:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee129e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14116e expref: 37 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.156566:0:17066:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee12a5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14116e expref: 36 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.156576:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c491a00) 00010000:00010000:3.0:1783135757.156580:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783135757.156584:0:17066:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c527a00, rc 0) 00000100:00100000:3.0:1783135757.156817:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+36:15657:x1869752786101376:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1044us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135757.156828:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:1.0:1783135757.160577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.160850:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786101504 00000100:00100000:2.0:1783135757.160864:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786101504 00000100:00100000:2.0:1783135757.160943:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:2.0:1783135757.160959:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac544177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+6:2400:x1869752786101504:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135757.160986:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135757.161028:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee12ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f141175 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135757.161066:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487e0d, blocks: 0x0 00010000:00010000:2.0:1783135757.161140:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=660s v=(0 0) 00010000:00010000:2.0:1783135757.161146:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135757.161157:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee12ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141175 expref: 7 pid: 18574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.161181:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee12ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141175 expref: 7 pid: 18574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.161214:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c800, rc 0) 00000100:00100000:0.0:1783135757.161736:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac544177800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:2400:x1869752786101504:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 776us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135757.161745:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:1.0:1783135757.164017:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135757.164453:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786101760 00000100:00100000:3.0:1783135757.164467:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786101760 00000100:00100000:3.0:1783135757.164598:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:3.0:1783135757.164612:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+36:15657:x1869752786101760:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135757.164810:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+36:15657:x1869752786101760:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 201us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135757.164819:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:1.0:1783135757.173573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135757.173697:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786101888 00000100:00100000:1.0:1783135757.173709:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786101888 00000100:00100000:1.0:1783135757.173776:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:1.0:1783135757.173786:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+36:15657:x1869752786101888:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783135757.182975:0:17044:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1783135757.182997:0:17044:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1783135757.183058:0:17044:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1783135757.183253:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183270:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183280:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183287:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20fa00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135757.183293:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183303:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183332:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ac6508cfd00) 00010000:00010000:0.0:1783135757.183336:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135757.183342:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183350:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20fa00/0xf7de4ef628ee10e5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183513:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183521:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183526:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183530:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135757.183533:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183538:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183546:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:0.0:1783135757.183548:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135757.183551:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183556:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e600/0xf7de4ef628ee10ec lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17065 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183582:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183587:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183593:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183598:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20f800 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135757.183600:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183606:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183614:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ac6508cf200) 00010000:00010000:0.0:1783135757.183617:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135757.183620:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183624:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20f800/0xf7de4ef628ee1194 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183638:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183644:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183648:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183659:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e20e000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135757.183662:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183667:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183674:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135757.183676:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135757.183679:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183684:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e000/0xf7de4ef628ee1219 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135757.183694:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+17:15657:x1869752786101888:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 Request processed in 9902us (10125us total) trans 0 rc 0/0 00010000:00010000:0.0:1783135757.183696:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183702:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135757.183707:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 61 00010000:00010000:0.0:1783135757.183708:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183713:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c600 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135757.183716:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183721:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183738:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c491a00) 00010000:00010000:0.0:1783135757.183740:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783135757.183744:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.183749:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee1290 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135757.183769:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135757.183791:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809248384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783135757.183871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135757.184312:0:19680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809248384 00000100:00100000:0.0:1783135757.184321:0:19680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809248384 00010000:00010000:3.0:1783135757.184581:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.184594:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.184601:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.184632:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65c000 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135757.184637:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.184645:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.184657:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ac6508cff00) 00010000:00010000:3.0:1783135757.184659:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1783135757.184664:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.184670:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c000/0xf7de4ef628ee1139 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135757.184776:0:19680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135757.184788:0:19680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809248384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783135757.184959:0:19680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783135757.184963:0:19680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1783135757.184966:0:19680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783135757.184969:0:19680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783135757 -> 1783135757 00002000:00010000:0.0:1783135757.184972:0:19680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1783135757.185029:0:19680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3649:x1869752809248384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (1158us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783135757.185038:0:19680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:0.0:1783135757.185119:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ac67f886d80/2, rc 0, transno 8589934596 00000100:00100000:0.0:1783135757.185126:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f886d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809248384:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1783135757.188733:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135757.190729:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135757.191526:0:18950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786102016 00000100:00100000:0.0:1783135757.191541:0:18950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786102016 00000100:00100000:0.0:1783135757.191714:0:18950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:0.0:1783135757.191727:0:18950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:2401:x1869752786102016:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783135757.192118:0:18950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:2401:x1869752786102016:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 Request processed in 392us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135757.192129:0:18950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:1.0:1783135757.196135:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.196255:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786102272 00000100:00100000:2.0:1783135757.196269:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786102272 00000100:00100000:2.0:1783135757.196361:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:2.0:1783135757.196374:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+15:15657:x1869752786102272:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135757.196463:0:17772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135757.196498:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c527a00/0xf7de4ef628ee12a5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14116e expref: 15 pid: 17066 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.196524:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c491a00) 00010000:00010000:2.0:1783135757.196531:0:17772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135757.196571:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee12b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.196586:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee12b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.196597:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee12b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135757.196766:0:17772:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cea35be2 reply state 000000006bcefc81 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee12b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.196781:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65de00/0xf7de4ef628ee12b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.196810:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c491a00) 00010000:00010000:2.0:1783135757.196813:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1783135757.196817:0:17772:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135757.196964:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+16:15657:x1869752786102272:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 591us (890us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1783135757.196972:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:2.0:1783135757.201320:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135757.201420:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786102400 00000100:00100000:0.0:1783135757.201436:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786102400 00000100:00100000:0.0:1783135757.201523:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:0.0:1783135757.201536:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:2400:x1869752786102400:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783135757.201760:0:18574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783135757.201764:0:18574:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1783135756 00002000:00010000:0.0:1783135757.201766:0:18574:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1783135756 00002000:00010000:0.0:1783135757.201769:0:18574:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783135757 -> 1783135756 00002000:00010000:0.0:1783135757.201771:0:18574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1783135757.201864:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+8:2400:x1869752786102400:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 330us (556us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783135757.201873:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:1.0:1783135757.206297:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135757.206499:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786102528 00000100:00100000:3.0:1783135757.206513:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786102528 00000100:00100000:3.0:1783135757.206590:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:3.0:1783135757.206602:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+8:2401:x1869752786102528:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783135757.206676:0:18573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee12ba lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.206698:0:18573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135757.206704:0:18573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135757.206714:0:18573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee12ba lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.206732:0:18573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee12ba lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.206791:0:18573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee12ba lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.206802:0:18573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee12ba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.206812:0:18573:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee12ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.206820:0:18573:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526a00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:3.0:1783135757.206825:0:18573:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee12ba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.206834:0:18573:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee12ba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.206854:0:18573:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee12ba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.206862:0:18573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51d7ae6/0xf7de4ef628ee12ba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135757.207068:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+8:2401:x1869752786102528:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 Request processed in 464us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135757.207079:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:2.0:1783135757.215956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135757.216150:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786102784 00000100:00100000:1.0:1783135757.216162:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786102784 00000100:00100000:1.0:1783135757.216250:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:1.0:1783135757.216262:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+16:15657:x1869752786102784:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783135757.216396:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.216418:0:17066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14113d expref: 16 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.216429:0:17066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.216475:0:17066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14113d expref: 16 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.216491:0:17066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14113d expref: 16 pid: 17772 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135757.216510:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17066:1869752809248512:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135757.216637:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d180 going to sleep for 11 seconds 00000100:00100000:3.0:1783135757.219369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135757.219572:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786102912 00000100:00100000:0.0:1783135757.219583:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786102912 00010000:00010000:0.0:1783135757.219638:0:17049:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14113d expref: 17 pid: 17772 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135757.219693:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:0.0:1783135757.219726:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+17:2401:x1869752786102912:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135757.219748:0:17049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135757.219756:0:17049:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14113d expref: 17 pid: 17772 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.219769:0:17049:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14113d expref: 17 pid: 17772 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.219802:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e20e400/0xf7de4ef628ee1212 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14113d expref: 17 pid: 17772 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.219826:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135757.219833:0:17049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee122e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14114b expref: 16 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.219846:0:17049:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.219855:0:17049:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.219864:0:17049:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.219888:0:17049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135757.219898:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17066:1869752809248512:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135757.219929:0:17066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.219942:0:17066:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.219949:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135757.219961:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+16:2401:x1869752786102912:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 236us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135757.219970:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00010000:00010000:1.0:1783135757.220322:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.220337:0:17066:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1297 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141167 expref: 16 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.220346:0:17066:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.220484:0:17066:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1297 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141167 expref: 16 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.220501:0:17066:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1297 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141167 expref: 16 pid: 17064 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135757.220518:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17066:1869752809248640:192.168.204.6@tcp:104: 00000100:00100000:1.0:1783135757.220805:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac54317d480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135757.225984:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f887800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17066:1869752809248640:192.168.204.6@tcp:104: 00010000:00010000:1.0:1783135757.226049:0:17066:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135757.226517:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135757.230997:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786103040 00000100:00100000:1.0:1783135757.231021:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786103040 00010000:00010000:1.0:1783135757.231111:0:17050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1297 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141167 expref: 17 pid: 17064 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135757.231212:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:1.0:1783135757.231223:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+17:2400:x1869752786103040:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135757.231243:0:17050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135757.231263:0:17050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1297 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141167 expref: 17 pid: 17064 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.231278:0:17050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1297 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141167 expref: 17 pid: 17064 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.231305:0:17050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d600/0xf7de4ef628ee1297 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141167 expref: 17 pid: 17064 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.231327:0:17050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c491a00) 00010000:00010000:1.0:1783135757.231334:0:17050:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.231345:0:17050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.231365:0:17050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.231563:0:17050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135757.231727:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+16:2400:x1869752786103040:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 504us (5212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135757.231737:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00010000:00010000:3.0:1783135757.232033:0:17066:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.232051:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135757.232224:0:17066:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1783135757.232402:0:17066:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1783135757.232447:0:17066:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1783135757.232555:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17066:1869752809248768:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783135757.232630:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135757.232683:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac675342900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135757.233274:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809248768 00000100:00100000:2.0:1783135757.233286:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809248768 00000100:00100000:2.0:1783135757.233347:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783135757.233369:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17066:x1869752809248768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783135757.233502:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17066:x1869752809248768:12345-0@lo:1000:mdt00_002.0 Request processed in 135us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135757.233511:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783135757.233836:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17066:1869752809248768:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1783135757.234054:0:17066:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1783135757.234142:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17066:1869752809248896:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783135757.234180:0:17066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135757.234210:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135757.234806:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809248896 00000100:00100000:0.0:1783135757.234836:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809248896 00000100:00100000:0.0:1783135757.234883:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135757.234894:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17066:x1869752809248896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783135757.235119:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17066:x1869752809248896:12345-0@lo:1000:mdt00_002.0 Request processed in 226us (936us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1783135757.235127:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783135757.235304:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17066:1869752809248896:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783135757.235373:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235521:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235531:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235538:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908200 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135757.235544:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235564:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235584:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c491a00) 00010000:00010000:3.0:1783135757.235587:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135757.235592:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235598:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f908200/0xf7de4ef628ee12c8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235639:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235646:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235651:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235656:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65d400 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:3.0:1783135757.235659:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235665:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235673:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:3.0:1783135757.235675:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135757.235683:0:17066:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee122e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14114b expref: 19 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235707:0:17066:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee122e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14114b expref: 19 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235718:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee122e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14114b expref: 19 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.235784:0:17066:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d800/0xf7de4ef628ee122e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14114b expref: 19 pid: 17065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135757.235800:0:17066:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17066:1869752809249024:192.168.204.6@tcp:105: 00000100:00100000:3.0:1783135757.235890:0:17066:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac5439873c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135757.239920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135757.240148:0:17066:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17066:1869752809249024:192.168.204.6@tcp:105: 00010000:00010000:0.0:1783135757.240180:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240192:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65d400/0xf7de4ef628ee1227 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240236:0:17066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ae00/0xf7de4ef628ee12cf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240269:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ae00/0xf7de4ef628ee12cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240285:0:17066:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ae00/0xf7de4ef628ee12cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240298:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ae00/0xf7de4ef628ee12cf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240304:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ae00/0xf7de4ef628ee12cf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240311:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ae00/0xf7de4ef628ee12cf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240317:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67e64ae00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135757.240342:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ae00/0xf7de4ef628ee12cf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240361:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ae00/0xf7de4ef628ee12cf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240378:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135757.240382:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135757.240394:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ae00/0xf7de4ef628ee12cf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240401:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67e64ae00/0xf7de4ef628ee12cf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240413:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240420:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240426:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240432:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f909c00 already unused, calling callback (ffffffffc18eb4f0) 00010000:00010000:0.0:1783135757.240436:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240441:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240449:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:0.0:1783135757.240452:0:17066:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135757.240462:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.240468:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67f909c00/0xf7de4ef628ee12c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17066 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135757.240684:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:07e1865a-1721-4bc6-87c1-03d8d78664fd+19:15657:x1869752786102784:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 24423us (24742us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1783135757.240698:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 63 00000020:00080000:0.0:1783135757.240705:0:17066:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783135757.241054:0:17099:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783135757.241060:0:17099:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135757.241084:0:17099:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783135757.241121:0:17099:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783135757.242440:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786103168 00000100:00100000:2.0:1783135757.242460:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786103168 00000100:00100000:2.0:1783135757.242627:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:2.0:1783135757.242641:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543773050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+19:15656:x1869752786103168:12345-192.168.204.6@tcp:49:dd.0 00000100:00100000:2.0:1783135757.242818:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543773050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+19:15656:x1869752786103168:12345-192.168.204.6@tcp:49:dd.0 Request processed in 180us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135757.242826:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:1.0:1783135757.249596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135757.249758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135757.249918:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786103424 00000100:00100000:3.0:1783135757.249932:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786103424 00000100:00100000:3.0:1783135757.250008:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:3.0:1783135757.250020:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+19:15657:x1869752786103424:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783135757.250740:0:17067:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783135757.250788:0:17067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1783135757.250832:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.250854:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.250868:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.250902:0:17067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.250910:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.250916:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.250989:0:17067:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783135757.251155:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+21:15657:x1869752786103424:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 1135us (1574us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1783135757.251166:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000020:00080000:3.0:1783135757.251172:0:17067:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783135757.253073:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786103552 00000100:00100000:2.0:1783135757.253113:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786103552 00000100:00100000:2.0:1783135757.253192:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:2.0:1783135757.253204:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+21:15656:x1869752786103552:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:2.0:1783135757.253257:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135757.253282:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee12dd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2a828d5c0f14117c expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.253321:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee12e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.253336:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee12e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.253348:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee12e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.253506:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65ca00/0xf7de4ef628ee12dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14117c expref: 23 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.253529:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c65c600/0xf7de4ef628ee12e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f14117c expref: 22 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.253538:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ac6508cf700) 00010000:00010000:2.0:1783135757.253541:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135757.253546:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ac67c65c600, rc 0) 00000100:00100000:2.0:1783135757.253932:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+22:15656:x1869752786103552:12345-192.168.204.6@tcp:101:dd.0 Request processed in 727us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135757.253941:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 64 00010000:00010000:0.0:1783135757.254228:0:17053:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135757.254245:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.254253:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c526a00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135757.254257:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.254266:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.254279:0:17053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ac67c491a00) 00010000:00010000:0.0:1783135757.254281:0:17053:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783135757.254284:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.254288:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ac67c526a00/0xf7de4ef628ee12d6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.254298:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135757.254300:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135757.254301:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135757.443456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1783135757.445336:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786103680 00000100:00100000:2.0:1783135757.445361:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786103680 00000100:00100000:2.0:1783135757.445496:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:2.0:1783135757.445509:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67f884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+8:2400:x1869752786103680:12345-192.168.204.6@tcp:4:dd.0 00010000:00010000:2.0:1783135757.445561:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.445583:0:18578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee12ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141175 expref: 8 pid: 18574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.445592:0:18578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783135757.445597:0:18578:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135757.445602:0:18578:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.445639:0:18578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee12ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141175 expref: 8 pid: 18574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.445654:0:18578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee12ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141175 expref: 8 pid: 18574 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135757.445670:0:18578:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18578:1869752809249152:192.168.204.6@tcp:104: 00000100:00100000:2.0:1783135757.445775:0:18578:0:(client.c:2701:ptlrpc_set_wait()) set ffff8ac6467c3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135757.446594:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1783135757.447890:0:18579:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783135757.451441:0:18579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1783135757.452733:0:18578:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18578:1869752809249152:192.168.204.6@tcp:104: 00010000:00010000:3.0:1783135757.452772:0:18578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135757.452886:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1783135757.453422:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786103936 00000100:00100000:3.0:1783135757.453434:0:17049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786103936 00010000:00010000:3.0:1783135757.453488:0:17049:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee12ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141175 expref: 9 pid: 18574 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135757.453659:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:3.0:1783135757.453682:0:17049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+9:2401:x1869752786103936:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135757.453704:0:17049:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135757.453750:0:17049:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee12ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141175 expref: 9 pid: 18574 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.453766:0:17049:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee12ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141175 expref: 9 pid: 18574 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.453799:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afd2481/0xf7de4ef628ee12ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x2a828d5c0f141175 expref: 9 pid: 18574 timeout: 761 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.453822:0:17049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135757.453828:0:17049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135757.453835:0:17049:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.453846:0:17049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.453882:0:17049:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135757.453953:0:17049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+8:2401:x1869752786103936:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 282us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135757.453962:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00010000:00010000:3.0:1783135757.453998:0:18578:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135757.454008:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135757.454396:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786103808 00000100:00100000:0.0:1783135757.454410:0:18579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786103808 00000100:00100000:1.0:1783135757.461942:0:20209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:1.0:1783135757.461964:0:20209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+8:2401:x1869752786103808:12345-192.168.204.6@tcp:4:dd.0 00010000:00010000:1.0:1783135757.462018:0:20209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee12f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.462036:0:20209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135757.462040:0:20209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135757.462046:0:20209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee12f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135757.462059:0:20209:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee12f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135757.643993:0:19388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1783135757.644012:0:19388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1783135757.644269:0:18578:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1783135757.644274:0:18578:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1783135756 -> 1783135757 00002000:00010000:2.0:1783135757.644276:0:18578:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1783135756 -> 1783135757 00002000:00010000:2.0:1783135757.644279:0:18578:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1783135757.644297:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.644338:0:18578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.644356:0:18578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.644364:0:18578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67c65ca00 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:2.0:1783135757.644369:0:18578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.644389:0:18578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.644411:0:18578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135757.644419:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087a18d4b/0xf7de4ef628ee12eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135757.644534:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67f884000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:07e1865a-1721-4bc6-87c1-03d8d78664fd+7:2400:x1869752786103680:12345-192.168.204.6@tcp:4:dd.0 Request processed in 199022us (201085us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783135757.644545:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:2.0:1783135757.678973:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809249280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135757.679052:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135757.679269:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809249408:0@lo:400:kworker.0 00000100:00100000:1.0:1783135757.679311:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135757.679388:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809249920:0@lo:400:kworker.0 00000100:00100000:1.0:1783135757.679414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135757.679431:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809250432:0@lo:400:kworker.0 00000100:00100000:1.0:1783135757.679456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135757.679482:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783135757.679488:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809249536:0@lo:400:kworker.0 00000100:00100000:1.0:1783135757.679510:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135757.679526:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809250048:0@lo:400:kworker.0 00000100:00100000:1.0:1783135757.679547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135757.679566:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809250560:0@lo:400:kworker.0 00000100:00100000:1.0:1783135757.679586:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135757.679621:0:17059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809249408 00000100:00100000:1.0:1783135757.679628:0:17059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809249408 00000100:00100000:1.0:1783135757.679681:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783135757.679691:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3646:x1869752809249408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135757.679748:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e206050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd33be97-b4c1-460b-98a5-4a7a9daa67b8+24:3646:x1869752809249408:12345-0@lo:400:kworker.0 Request processed in 57us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135757.679755:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783135757.679789:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809249920 00000100:00100000:1.0:1783135757.679793:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809249920 00000100:00100000:3.0:1783135757.680270:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809249536 00000100:00100000:3.0:1783135757.680284:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809249536 00000100:00100000:3.0:1783135757.680312:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783135757.680319:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809249536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.680383:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809249536:12345-0@lo:400:kworker.0 Request processed in 55us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135757.680390:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783135757.680413:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135757.680422:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac652ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809250944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783135757.680473:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809249664:0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.680496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135757.680516:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809250176:0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.680537:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135757.680556:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809250688:0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.680577:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135757.680595:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783135757.680601:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809249792:0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.680621:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135757.680636:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67f884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809250304:0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.680655:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135757.680665:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809250816:0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.680687:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135757.680712:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809250048 00000100:00100000:3.0:1783135757.680716:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809250048 00000100:00100000:3.0:1783135757.680753:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809249664 00000100:00100000:3.0:1783135757.680756:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809249664 00000100:00100000:3.0:1783135757.680776:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809250176 00000100:00100000:3.0:1783135757.680786:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809250176 00000100:00100000:3.0:1783135757.680805:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135757.680811:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809250048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.680845:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809250048:12345-0@lo:400:kworker.0 Request processed in 33us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135757.680851:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135757.680863:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783135757.680869:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809249664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.680899:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1869752809249664:12345-0@lo:400:kworker.0 Request processed in 30us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135757.680904:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783135757.680915:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783135757.680921:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809250176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.680948:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809250176:12345-0@lo:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135757.680953:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783135757.680971:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809250432 00000100:00100000:3.0:1783135757.680975:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809250432 00000100:00100000:3.0:1783135757.680997:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809250560 00000100:00100000:3.0:1783135757.681000:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809250560 00000100:00100000:3.0:1783135757.681011:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809250688 00000100:00100000:3.0:1783135757.681013:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809250688 00000100:00100000:3.0:1783135757.681023:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809249792 00000100:00100000:3.0:1783135757.681025:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809249792 00000100:00100000:3.0:1783135757.681035:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809250304 00000100:00100000:3.0:1783135757.681037:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809250304 00000100:00100000:3.0:1783135757.681046:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809250816 00000100:00100000:3.0:1783135757.681049:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809250816 00000100:00100000:2.0:1783135757.681340:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809249280 00000100:00100000:2.0:1783135757.681361:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809249280 00010000:00010000:0.0:1783135757.681564:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135757.681597:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783135757.681607:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809250432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135757.681648:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1869752809250432:12345-0@lo:400:kworker.0 Request processed in 44us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135757.681654:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783135757.681671:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135757.681676:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809250560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135757.681704:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1869752809250560:12345-0@lo:400:kworker.0 Request processed in 28us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135757.681710:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135757.681721:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135757.681726:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809250688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135757.681754:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1869752809250688:12345-0@lo:400:kworker.0 Request processed in 27us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135757.681759:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135757.681770:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135757.681776:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809249792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135757.681800:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1869752809249792:12345-0@lo:400:kworker.0 Request processed in 25us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135757.681806:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135757.681828:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783135757.681834:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac652ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809250304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135757.681864:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1869752809250304:12345-0@lo:400:kworker.0 Request processed in 30us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135757.681870:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783135757.681928:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809249536:0@lo:400:kworker.0 00000100:00100000:0.0:1783135757.681943:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809250048:0@lo:400:kworker.0 00010000:00080000:0.0:1783135757.681956:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543960a80 x1869752809250560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135757.681968:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543960a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1869752809250560:0@lo:400:kworker.0 00000100:00100000:0.0:1783135757.681978:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd33be97-b4c1-460b-98a5-4a7a9daa67b8:3646:1869752809249408:0@lo:400:kworker.0 00000100:00100000:0.0:1783135757.681989:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1869752809250432:0@lo:400:kworker.0 00000100:00100000:0.0:1783135757.682011:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135757.682021:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809251072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135757.682048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135757.682172:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783135757.682182:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809249920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135757.682220:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1869752809249920:12345-0@lo:400:kworker.0 Request processed in 41us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135757.682227:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783135757.682414:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1869752809249920:0@lo:400:kworker.0 00000100:00080000:1.0:1783135757.682745:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135757.682756:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135757.682759:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135757.682761:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135757.682781:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135757.682850:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783135757.682866:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac541d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809250816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.682907:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac541d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1869752809250816:12345-0@lo:400:kworker.0 Request processed in 43us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135757.682913:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783135757.682945:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1869752809249792:0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.682958:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1869752809250304:0@lo:400:kworker.0 00010000:00080000:3.0:1783135757.682971:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ac543960700 x1869752809250816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135757.682981:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543960700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1869752809250816:0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.682992:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1869752809249664:0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.683004:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67f886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809250176:0@lo:400:kworker.0 00000100:00100000:3.0:1783135757.683014:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1869752809250688:0@lo:400:kworker.0 00000100:00100000:2.0:1783135757.692673:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809251072 00000100:00100000:2.0:1783135757.692690:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809251072 00000100:00100000:2.0:1783135757.693042:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809250944 00000100:00100000:2.0:1783135757.693047:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809250944 00000100:00100000:2.0:1783135757.693160:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135757.693175:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809249280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135757.693215:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783135757.694179:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1869752809249280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1004us (15124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135757.694190:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135757.694213:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783135757.694221:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809251072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135757.694317:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29810368 pending 3485696 free 3923513344 avail 3687772160 00000100:00100000:1.0:1783135757.694520:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c651c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1869752809249280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135757.694604:0:3646:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1783135757.694611:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ac67f886d80, transno 8589934596 00000004:00080000:0.0:1783135757.694628:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1783135757.694674:0:3646:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1869752809251072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135757.694937:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1869752809251072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 716us (12886us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135757.694945:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783135757.695479:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135757.695492:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809250944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783135757.695514:0:18577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29810368 pending 3485696 free 3923513344 avail 3687772160 00000100:00100000:2.0:1783135757.695619:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1869752809250944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (12838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135757.695626:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000001:00080000:3.0:1783135757.697406:0:19388:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1783135757.697656:0:20209:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1783135757.697661:0:20209:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1783135757.697681:0:20209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee12f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.697707:0:20209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee12f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.697727:0:20209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee12f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.697734:0:20209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ac67f908000 already unused, calling callback (ffffffffc0ce1ce0) 00010000:00010000:0.0:1783135757.697739:0:20209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee12f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.697749:0:20209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee12f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.697770:0:20209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee12f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135757.697777:0:20209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ff89676/0xf7de4ef628ee12f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135757.697930:0:20209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac652aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2401:x1869752786103808:12345-192.168.204.6@tcp:4:dd.0 Request processed in 235969us (251341us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783135757.697941:0:20209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:1.0:1783135757.698147:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac652ae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1869752809250944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783135758.706672:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135758.706699:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809251200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783135758.706795:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135758.706946:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809251200 00000100:00100000:2.0:1783135758.706955:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809251200 00000100:00100000:2.0:1783135758.707013:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135758.707022:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809251200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783135758.707058:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1783135758.707143:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1869752809251200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135758.707150:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135758.707225:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1869752809251200:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1783135758.711623:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135758.925802:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135758.925852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135758.925890:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135758.925914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135758.925939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135758.926106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135758.926135:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135758.926158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135758.926250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1783135758.926289:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786104064 00000100:00100000:1.0:1783135758.926304:0:17056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786104064 00000100:00100000:1.0:1783135758.926429:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 170 00000100:00100000:1.0:1783135758.926440:0:17056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67e206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+13:2399:x1869752786104064:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135758.926522:0:17056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67e206c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:455f3cf7-16ee-408c-8389-ea23e4967612+13:2399:x1869752786104064:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 83us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135758.926530:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 170 00000100:00100000:1.0:1783135758.926567:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786104576 00000100:00100000:1.0:1783135758.926570:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786104576 00000100:00100000:1.0:1783135758.926619:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786105088 00000100:00100000:1.0:1783135758.926622:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786105088 00000100:00100000:1.0:1783135758.926643:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786104448 00000100:00100000:1.0:1783135758.926646:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786104448 00000100:00100000:1.0:1783135758.926656:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786104960 00000100:00100000:1.0:1783135758.926657:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786104960 00000100:00100000:1.0:1783135758.926671:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:1.0:1783135758.926677:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786104576:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135758.926706:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786104576:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 29us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135758.926713:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:1.0:1783135758.926725:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:1.0:1783135758.926731:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06406641-6839-4a1a-8419-9f7c420b54d1+5:2399:x1869752786105088:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135758.926750:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06406641-6839-4a1a-8419-9f7c420b54d1+5:2399:x1869752786105088:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 19us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135758.926755:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:1.0:1783135758.926764:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:1.0:1783135758.926768:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786104448:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135758.926790:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786104448:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 21us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135758.926795:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:1.0:1783135758.926803:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:1.0:1783135758.926808:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06406641-6839-4a1a-8419-9f7c420b54d1+5:2399:x1869752786104960:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135758.926825:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543961f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:06406641-6839-4a1a-8419-9f7c420b54d1+5:2399:x1869752786104960:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 17us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135758.926839:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:1.0:1783135758.926858:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786104320 00000100:00100000:1.0:1783135758.926861:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786104320 00000100:00100000:1.0:1783135758.926882:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786104832 00000100:00100000:1.0:1783135758.926884:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786104832 00000100:00100000:1.0:1783135758.926894:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786104192 00000100:00100000:1.0:1783135758.926896:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786104192 00000100:00100000:1.0:1783135758.926906:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752786104704 00000100:00100000:1.0:1783135758.926908:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752786104704 00000100:00100000:1.0:1783135758.926921:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:1.0:1783135758.926927:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786104320:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135758.926964:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+5:2399:x1869752786104320:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 37us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135758.927079:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:1.0:1783135758.927111:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:1.0:1783135758.927117:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+5:2399:x1869752786104832:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135758.927142:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+5:2399:x1869752786104832:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135758.927147:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:1.0:1783135758.927157:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:1.0:1783135758.927162:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+22:2399:x1869752786104192:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135758.927251:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:07e1865a-1721-4bc6-87c1-03d8d78664fd+22:2399:x1869752786104192:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 88us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135758.927257:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:1.0:1783135758.927412:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:1.0:1783135758.927425:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+6:2399:x1869752786104704:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1783135758.927447:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:06406641-6839-4a1a-8419-9f7c420b54d1+6:2399:x1869752786104704:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135758.927453:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00080000:1.0:1783135758.927722:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135758.927727:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783135758.927730:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135758.927733:0:17060:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135759.220952:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135759.220975:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac543bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809251328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783135759.221051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135759.221169:0:17806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809251328 00000100:00100000:0.0:1783135759.221178:0:17806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809251328 00000100:00100000:0.0:1783135759.221231:0:17806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783135759.221247:0:17806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac543962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809251328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783135759.221281:0:17806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783135759.221341:0:17806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac543962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1869752809251328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135759.221348:0:17806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783135759.221395:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac543bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1869752809251328:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1783135759.599696:0:20246:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1783135759.726786:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135759.726821:0:3647:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8ac67c652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809251456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783135759.726920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135759.726987:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752809251456 00000100:00100000:2.0:1783135759.726996:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752809251456 00000100:00100000:2.0:1783135759.727066:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783135759.727077:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ac67c651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809251456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783135759.727159:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783135759.727215:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ac67c651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1869752809251456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135759.727224:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783135759.727280:0:3647:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8ac67c652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1869752809251456:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1783135759.728397:0:17053:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135760.494806:0:17819:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135760.754638:0:17052:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135761.774512:0:18220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43314 lines, 43314 kept, 0 dropped, 0 bad.